July 2020 - CollEc-run

darni crashed
by Thomas Krichel 30 Jul '20

30 Jul '20

At 23:45 last night. I woke up shortly after that. A hardware reset I performed about 25 minutes later brought it back. I did not find a trace in the log as to what may have caused the crash. Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel

2 4

Re: [CollEc] CollEc 2.0 Access
by Thomas Krichel 23 Jul '20

23 Jul '20

Düben, Christian writes > Vimeo apparently does not display ads. But that > might change at one point and I am not going to monitor that > platform's ad policy. Therefore, I hosted the video locally for now, > despite the mentioned disadvantages. It's up to you really. > I added the daily update routine to the crontab file. I was wondering if you had stopped because the load of the server seems to have drastically declined. I don't notice it any more. > The loading time at app startup is annoying It seems much faster now. I think it reaches ok state. I mean a lot of sites are slow these day, maybe we need to keep up with the times. > and I looked into its > causes and ways to circumvent it. Its source is the way ShinyProxy > makes the app available. Whenever a user accesses the app, > ShinyProxy spins up a new Docker container with the app in it. Once > the user becomes inactive, ShinyProxy removes the container. And the > initial startup time is essentially the time it takes to spin up > that container. If users were first directed to an index page, on > which they select the app, I could pre-initialize the container once > they enter that index page. Unfortunately, ShinyProxy does not > support pre-initializing containers when users access the app > directly, like in our case. In short, the loading time at startup > remains for now. Is it normal that it is all grey? Would it not be possible to set up static pages, and have the app only be active if there is a need to work on user input? I think that the start page explains what the service does. Then there should be a video, and then background and whosdone it. CollEc is a RePEc service that evaluates the economic literature's co-authorship network. It allows you to assess bilateral distances and centrality measures like closeness and betweenness for more than 47,000 authors. As in GraphEc, you interact with the results through graphical representations. Feel free to watch the following tutorial for a brief introduction to CollEc's functionalities. Note that the video player depends on your browser. In some browsers you may need to right-click on the video to select the full screen option. like closeness and betweenness --> called closeness and betweenness Then I suggest the video and then It is maintained by Christian Düben. Our data comes from the RePEc Author Service, a RePEc service maintained by Christian Zimmermann . Further details are available in the documentation . CollEc was founded by Thomas Krichel in 2011. I am not sure we need you and me in the end here because we have it in the footer. > Could you tell me how you linked test.collec.repec.org to the app? > As I mentioned in an earlier e-mail, it does not work. I would need > some specifics to find the bug. It was a five-minute job. root@darni ~ # cat /etc/apache2/sites-available/collec.repec.org <VirtualHost *:80> ServerName test.collec.repec.org ServerAlias test.collec.openlib.org ErrorLog /var/log/apache2/collec.proxy-error.log CustomLog /var/log/apache2/collec-access.log combined UseCanonicalName Off ProxyPass / http://localhost:8080/ ProxyPassReverse / http://localhost:8080/ </VirtualHost> > I can barely talk without coughing these days. But I am going to produce the video as soon as possible. > > Apart from the video and the URL connection issue, I think that the app is ready to become publicly available. > > I have the impression that you upset or unsatisfied with this project. Did I do something that upset you? Did the app development take too long? Do you not like the layout or the content? I could have developed the app faster, but I wanted to try various optimizations before releasing it. And familiarizing myself with Docker, MariaDB, ShinyProxy, Shiny etc. took a while. I am sorry, if I upset you. Please feel free to provide any feedback or suggestions. > I'm very sorry for appearing to be grumpy! I don't know how to use the selection screen. The select by is confusing. I don't seem to be able to get anything from it. I type "Krichel" or pkr1 in there and just nothing happens. I think we need the ranked lists there and finally we will need exports. -- Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel

3 24

Re: [CollEc] CollEc 2.0 Access
by Thomas Krichel 17 Jul '20

17 Jul '20

Düben, Christian writes > Did the app development take too long? No way. You work lightening speed compared to me. RePEc has never been about doing things fast. But I'm reaching new lows. I have been struggling with ArchEc over the past weeks in an intesely frustrating experience. The other day I managed to ruin 170000 files there, hundreds needing manual fixing. -- Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel

1 0

Re: [CollEc] CollEc 2.0 Access
by Thomas Krichel 17 Jul '20

17 Jul '20

Düben, Christian writes > I have the impression that you upset or unsatisfied with this project. Not at all. I'm upset with my own lack of work on this. -- Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel

1 0

Re: [CollEc] CollEc 2.0 Access
by Thomas Krichel 15 Jul '20

15 Jul '20

Düben, Christian writes > I am still working on the database performance. Insertion times > dropped but did not reach a satisfactory level yet. However, as the > application is done except for the database issue, I decided to seek > feedback from your side already. You can access it at > "http://95.216.35.87:8080" For that I already have test.collec.repec.org > with the user name "Test_User" Why do I need to sign in? It's too slow after sign in. In general, darni is dreadfully slow today. I think the i/o is the bottleneck. I have been deleting files as we reached %94 full. Few Otto Normaleconomists will understand the weighted networks. Data entry should not ask to fill a name or fill a handle, but detect whether the entry is a name or a handle. Ideally, one should enter family names as well as they are more famliar to users who search. I think you need to start with a simple note, where the screen is cached. > The video embedded in the "Introduction" tab is a placeholder and > will be replaced with the actual tutorial upon the new CollEc's > public release. The output generated in the "Distances", "Closeness" > and "Betweenness" tabs is temporarily not available as I am currently > working on the underlying MariaDB tables. I changed the documentation > a few times and am curious to hear your comments on it. I think it's better to give people a list of top nodes at the start, or just start with a screen very similar to the to one of the existing CollEc. It may not be a the best, but some folks got used to it. A video link should go to the docmentation page. -- Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel

3 7

Re: [CollEc] RePEc Visual
by Thomas Krichel 09 Jul '20

09 Jul '20

Düben, Christian writes > I went through some of the files and checked what I would need for > an extension of CollEc. I have a few ideas in mind on what to add > and how to present it in an interactive application. It's very hard to do a worse job than I did vizualizing that data! > When consulting our IT department here at Hamburg University, they > suggested to host RePEc Visual on one of their managed Linux > servers. At this point I am still waiting for the administration to > process my application requesting such a server. And just like every > administrative procedure at our institution, this takes a while. Once > I have access to the respective infrastructure I am going to test > implementations of RePEc Visual and potential CollEc extensions on > it. Those applications would of course run under an external domain, > not a Hamburg University domain. We could run this on the existing CollEc server. This would be especially valuable if you manage to find a way to run the calculations faster. At this time, it's dreadfully slow. You could just take over the whole thing, well almost. We need to keep the mention of the sponsor, and I'd like to be aknowledged as the orginal creator. > I do not have Telegram and apparently do not have the correct login > credentials for the Skype setup on my office Laptop. Do you use > Zoom? If you do, I can send you a meeting link. If you do not, I > will try to find out what login credentials our IT set for Skype. Zoom should be fine. I'm in UTC+7. I can do late evenings no problem. My schedule is completely open. Maybe someone else would want to attend? I copy CollEc-run. -- Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel

4 51