Should there be a redirect from collec.repec.org to app.collec.repec.org?
Or at least a mention and a link?
Christian Zimmermann FIGUGEGL!
Economic Research
Federal Reserve Bank of St. Louis
P.O. Box 442
St. Louis MO 63166-0442 USA
https://ideas.repec.org/zimm/ @CZimm_economist
I suppose there is now a bit more traffic to the app. Any issues so far?
Load?
Christian Zimmermann FIGUGEGL!
Economic Research
Federal Reserve Bank of St. Louis
P.O. Box 442
St. Louis MO 63166-0442 USA
https://ideas.repec.org/zimm/ @CZimm_economist
I replaced the placeholder video in the web application with an actual tutorial. It introduces the user to the basics of graphs and explains the app's different functionalities. Feel free to provide feedback on it.
What I did not get to work is properly linking the app to test.collec.repec.org. I am unexperienced with Apache and have no idea how to fix that configuration. The ShinyProxy website (https://www.shinyproxy.io/security/) mentions a configuration using Nginx:
server {
listen 80;
server_name shinyproxy.yourdomain.com;
rewrite ^(.*) https://$server_name$1 permanent;
}
server {
listen 443;
server_name shinyproxy.yourdomain.com;
access_log /var/log/nginx/shinyproxy.access.log;
error_log /var/log/nginx/shinyproxy.error.log error;
ssl on;
ssl_protocols TLSv1 TLSv1.1 TLSv1.2;
ssl_certificate /etc/ssl/certs/yourdomain.com.crt;
ssl_certificate_key /etc/ssl/private/yourdomain.com.key;
location / {
proxy_pass http://127.0.0.1:8080/;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
proxy_read_timeout 600s;
proxy_redirect off;
proxy_set_header Host $http_host;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header X-Forwarded-Proto $scheme;
}
}
My questions on Stack Overflow (https://stackoverflow.com/q/63112223/9084488) and Server Fault (https://serverfault.com/q/1029219/587099) asking to translate that code to Apache did, unfortunately, not invoke any answers or comments.
Does anyone on this list know how to do this? The current configuration is:
<VirtualHost *:80>
ServerName test.collec.repec.org
ServerAlias test.collec.openlib.org
ErrorLog /var/log/apache2/collec.proxy-error.log
CustomLog /var/log/apache2/collec-access.log combined
UseCanonicalName Off
ProxyPass / http://localhost:8080/
ProxyPassReverse / http://localhost:8080/
RewriteEngine on
RewriteCond %{HTTP:Upgrade} =websocket
RewriteRule /(.*) ws://localhost:8080/$1 [P,L]
</VirtualHost>
Christian Düben
Research Associate
Chair of Macroeconomics
Hamburg University
Von-Melle-Park 5, Room 3102
20146 Hamburg
Germany
+49 40 42838 1898
christian.dueben(a)uni-hamburg.de<mailto:christian.dueben@uni-hamburg.de>
http://www.christian-dueben.com
Düben, Christian writes
> Any ideas why that happened?
that's what's in the journal.
Aug 10 15:47:31 darni sshd[3513693]: Received disconnect from 119.17.200.66 port 3323:11: Bye Bye [preauth]
Aug 10 15:47:31 darni sshd[3513693]: Disconnected from authenticating user root 119.17.200.66 port 3323 [preauth]
Aug 10 15:47:32 darni sshd[3513703]: Failed password for root from 124.93.160.82 port 52369 ssh2
Aug 10 15:47:33 darni sshd[3513703]: Received disconnect from 124.93.160.82 port 52369:11: Bye Bye [preauth]
Aug 10 15:47:33 darni sshd[3513703]: Disconnected from authenticating user root 124.93.160.82 port 52369 [preauth]
-- Reboot -Aug 10 16:34:29 darni kernel: microcode: microcode updated early to revision 0xd6, date = 2020-04-2Aug 10
16:34:29 darni kernel: Linux version 5.7.0-1-amd64 (debian-kernel(a)lists.debian.org) (gcc version 9.3.0 (Debian 9.3.0-14), GNU ld (GNU Binutils for Debian) 2.34) #1 SMP Debian 5.7.6-1 (2020-06-24)
Aug 10 16:34:29 darni kernel: Command line: BOOT_IMAGE=/vmlinuz-5.7.0-1-amd64 root=UUID=92d8b524-76e3-452c-b4ad-93765244e796 ro nomodeset consoleblank=0
Aug 10 16:34:29 darni kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
Just similar scenario as with previous crashes.
> I do not think that it had anything to do with the app.
I wouldn't go that far. I simply have no idea.
--
Cheers,
Thomas Krichel http://openlib.org/home/krichel
skype:thomaskrichel
At 23:45 last night. I woke up shortly after that.
A hardware reset I performed about 25 minutes later brought
it back. I did not find a trace in the log as to what may
have caused the crash.
Cheers,
Thomas Krichel http://openlib.org/home/krichel
skype:thomaskrichel
Düben, Christian writes
> Vimeo apparently does not display ads. But that
> might change at one point and I am not going to monitor that
> platform's ad policy. Therefore, I hosted the video locally for now,
> despite the mentioned disadvantages.
It's up to you really.
> I added the daily update routine to the crontab file.
I was wondering if you had stopped because the load of the server
seems to have drastically declined. I don't notice it any more.
> The loading time at app startup is annoying
It seems much faster now. I think it reaches ok state. I mean
a lot of sites are slow these day, maybe we need to keep up
with the times.
> and I looked into its
> causes and ways to circumvent it. Its source is the way ShinyProxy
> makes the app available. Whenever a user accesses the app,
> ShinyProxy spins up a new Docker container with the app in it. Once
> the user becomes inactive, ShinyProxy removes the container. And the
> initial startup time is essentially the time it takes to spin up
> that container. If users were first directed to an index page, on
> which they select the app, I could pre-initialize the container once
> they enter that index page. Unfortunately, ShinyProxy does not
> support pre-initializing containers when users access the app
> directly, like in our case. In short, the loading time at startup
> remains for now.
Is it normal that it is all grey?
Would it not be possible to set up static pages, and have the app only
be active if there is a need to work on user input?
I think that the start page explains what the service does. Then there should be
a video, and then background and whosdone it.
CollEc is a RePEc service that evaluates the economic literature's
co-authorship network. It allows you to assess bilateral distances and
centrality measures like closeness and betweenness for more than
47,000 authors. As in GraphEc, you interact with the results through
graphical representations.
Feel free to watch the following
tutorial for a brief introduction to CollEc's functionalities. Note
that the video player depends on your browser. In some browsers you
may need to right-click on the video to select the full screen option.
like closeness and betweenness --> called closeness and betweenness
Then I suggest the video and then
It is maintained by Christian Düben. Our data comes from the RePEc
Author Service, a RePEc service maintained by Christian Zimmermann
. Further details are available in the documentation .
CollEc was founded by Thomas Krichel in 2011.
I am not sure we need you and me in the end here because we
have it in the footer.
> Could you tell me how you linked test.collec.repec.org to the app?
> As I mentioned in an earlier e-mail, it does not work. I would need
> some specifics to find the bug.
It was a five-minute job.
root@darni ~ # cat /etc/apache2/sites-available/collec.repec.org
<VirtualHost *:80>
ServerName test.collec.repec.org
ServerAlias test.collec.openlib.org
ErrorLog /var/log/apache2/collec.proxy-error.log
CustomLog /var/log/apache2/collec-access.log combined
UseCanonicalName Off
ProxyPass / http://localhost:8080/
ProxyPassReverse / http://localhost:8080/
</VirtualHost>
> I can barely talk without coughing these days. But I am going to produce the video as soon as possible.
>
> Apart from the video and the URL connection issue, I think that the app is ready to become publicly available.
>
> I have the impression that you upset or unsatisfied with this project. Did I do something that upset you? Did the app development take too long? Do you not like the layout or the content? I could have developed the app faster, but I wanted to try various optimizations before releasing it. And familiarizing myself with Docker, MariaDB, ShinyProxy, Shiny etc. took a while. I am sorry, if I upset you. Please feel free to provide any feedback or suggestions.
>
I'm very sorry for appearing to be grumpy!
I don't know how to use the selection screen.
The select by is confusing. I don't seem to be able to get anything from
it. I type "Krichel" or pkr1 in there and just nothing happens.
I think we need the ranked lists there and finally we will need exports.
--
Cheers,
Thomas Krichel http://openlib.org/home/krichel
skype:thomaskrichel
Düben, Christian writes
> Did the app development take too long?
No way. You work lightening speed compared to me. RePEc has never
been about doing things fast. But I'm reaching new lows. I have been
struggling with ArchEc over the past weeks in an intesely
frustrating experience. The other day I managed to ruin 170000 files
there, hundreds needing manual fixing.
--
Cheers,
Thomas Krichel http://openlib.org/home/krichel
skype:thomaskrichel
Düben, Christian writes
> I have the impression that you upset or unsatisfied with this project.
Not at all. I'm upset with my own lack of work on this.
--
Cheers,
Thomas Krichel http://openlib.org/home/krichel
skype:thomaskrichel
Düben, Christian writes
> I am still working on the database performance. Insertion times
> dropped but did not reach a satisfactory level yet. However, as the
> application is done except for the database issue, I decided to seek
> feedback from your side already. You can access it at
> "http://95.216.35.87:8080"
For that I already have test.collec.repec.org
> with the user name "Test_User"
Why do I need to sign in?
It's too slow after sign in. In general, darni is dreadfully slow today.
I think the i/o is the bottleneck. I have been deleting files as we
reached %94 full.
Few Otto Normaleconomists will understand the weighted networks.
Data entry should not ask to fill a name or fill a handle,
but detect whether the entry is a name or a handle. Ideally,
one should enter family names as well as they are more famliar
to users who search.
I think you need to start with a simple note, where the screen is cached.
> The video embedded in the "Introduction" tab is a placeholder and
> will be replaced with the actual tutorial upon the new CollEc's
> public release. The output generated in the "Distances", "Closeness"
> and "Betweenness" tabs is temporarily not available as I am currently
> working on the underlying MariaDB tables. I changed the documentation
> a few times and am curious to hear your comments on it.
I think it's better to give people a list of top nodes at the start,
or just start with a screen very similar to the to one of
the existing CollEc. It may not be a the best, but some folks
got used to it. A video link should go to the docmentation
page.
--
Cheers,
Thomas Krichel http://openlib.org/home/krichel
skype:thomaskrichel
Düben, Christian writes
> I went through some of the files and checked what I would need for
> an extension of CollEc. I have a few ideas in mind on what to add
> and how to present it in an interactive application.
It's very hard to do a worse job than I did vizualizing that
data!
> When consulting our IT department here at Hamburg University, they
> suggested to host RePEc Visual on one of their managed Linux
> servers. At this point I am still waiting for the administration to
> process my application requesting such a server. And just like every
> administrative procedure at our institution, this takes a while. Once
> I have access to the respective infrastructure I am going to test
> implementations of RePEc Visual and potential CollEc extensions on
> it. Those applications would of course run under an external domain,
> not a Hamburg University domain.
We could run this on the existing CollEc server. This would
be especially valuable if you manage to find a way to run the
calculations faster. At this time, it's dreadfully slow. You could
just take over the whole thing, well almost. We need to keep the
mention of the sponsor, and I'd like to be aknowledged as the
orginal creator.
> I do not have Telegram and apparently do not have the correct login
> credentials for the Skype setup on my office Laptop. Do you use
> Zoom? If you do, I can send you a meeting link. If you do not, I
> will try to find out what login credentials our IT set for Skype.
Zoom should be fine. I'm in UTC+7. I can do late evenings no
problem. My schedule is completely open. Maybe someone else would
want to attend? I copy CollEc-run.
--
Cheers,
Thomas Krichel http://openlib.org/home/krichel
skype:thomaskrichel
