It looks like we found the recurrent issue of disappearing cron jobs on Helos. I read that crontab -e is the safer option, less prone to unintended consequences than directly editing the file is. Christian Düben Doctoral Candidate Chair of Macroeconomics Hamburg University Germany christian.dueben@uni-hamburg.de https://www.christian-dueben.com -----Original Message----- From: Thomas Krichel <krichel@openlib.org> Sent: Sonntag, 30. Juli 2023 17:08 To: Düben, Christian <christian.dueben@uni-hamburg.de> Subject: Re: [CollEc] helos overload Düben, Christian writes
All my cron jobs have been deleted from the cron tab, including the daily updating job.
dear.
Is that due to the fact that we edit the crontab differently? I use "EDITOR=nano crontab -e".
Colud be. I use the file /root/etc/crontab ; crontab /root/etc/crontab -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21240th day.
* the source of the recurrent issue Christian Düben Doctoral Candidate Chair of Macroeconomics Hamburg University Germany christian.dueben@uni-hamburg.de https://www.christian-dueben.com -----Original Message----- From: Düben, Christian Sent: Sonntag, 30. Juli 2023 17:17 To: CollEc Run <collec-run@lists.openlib.org> Subject: RE: [CollEc] helos overload It looks like we found the recurrent issue of disappearing cron jobs on Helos. I read that crontab -e is the safer option, less prone to unintended consequences than directly editing the file is. Christian Düben Doctoral Candidate Chair of Macroeconomics Hamburg University Germany christian.dueben@uni-hamburg.de https://www.christian-dueben.com -----Original Message----- From: Thomas Krichel <krichel@openlib.org> Sent: Sonntag, 30. Juli 2023 17:08 To: Düben, Christian <christian.dueben@uni-hamburg.de> Subject: Re: [CollEc] helos overload Düben, Christian writes
All my cron jobs have been deleted from the cron tab, including the daily updating job.
dear.
Is that due to the fact that we edit the crontab differently? I use "EDITOR=nano crontab -e".
Colud be. I use the file /root/etc/crontab ; crontab /root/etc/crontab -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21240th day.
The situation remains critical. I have edited the cron to get rid of the error, bbut it it not sufficient to save the machine. I will try a user agent rejection at nginx. -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21240th day.
This morning helos was again sick. I managed a reboot and switched off nginx. The solution should be to block the traffic by user agent. I tried this is the configuration. It did not work in the last crisis, it does not work in this. Failing to get this we need a better way to stop old containers. I have my funding application due today, so I really can't have this as a distraction. -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21241st day.
Thomas Krichel writes
The solution should be to block the traffic by user agent. I tried this is the configuration. It did not work in the last crisis, it does not work in this.
It's because I had it in the Collec 443 server {}. It needs to be in the 80 server. This seems to work 47.128.26.119 - - [31/Jul/2023:04:25:42 +0000] "GET /app_direct/collec_app/?g_author=%22pde736%22&navbars=%22tab_Coauthors%22 HTTP/1.1" 403 118 "-" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" 403 as desired. I have removed the docker killer cron entry # # */5 * * * * docker ps --filter "ancestor=collec_app" --filter "status=exited" | xargs docker rm 2> /dev/null -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21241st day.
Bytedance my arse... Talk about flogging a dead horse 13.214.2.80 - - [31/Jul/2023:11:18:00 +0000] "GET /app_direct/collec_app/?g_author=%22ppa813%22&navbars=%22tab_Coauthors%22 HTTP/1.1" 403 118 "-" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" 18.140.193.107 - - [31/Jul/2023:11:18:27 +0000] "GET /app_direct/collec_app/?g_author=%22pay117%22&navbars=%22tab_Coauthors%22 HTTP/1.1" 403 118 "-" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" 13.215.236.105 - - [31/Jul/2023:11:18:29 +0000] "GET /app_direct/collec_app/?g_author=%22pgo946%22&navbars=%22tab_Coauthors%22 HTTP/1.1" 403 118 "-" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" 54.251.210.130 - - [31/Jul/2023:11:18:57 +0000] "GET /app_direct/collec_app/?g_author=%22ppe453%22&navbars=%22tab_Coauthors%22 HTTP/1.1" 403 118 "-" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" 52.77.148.33 - - [31/Jul/2023:11:19:03 +0000] "GET /app_direct/collec_app/?g_author=%22pdu524%22&navbars=%22tab_Coauthors%22 HTTP/1.1" 403 118 "-" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" 18.143.60.151 - - [31/Jul/2023:11:19:13 +0000] "GET /app_direct/collec_app/?g_author=%22pso459%22&navbars=%22tab_Coauthors%22 HTTP/1.1" 403 118 "-" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21241st day.
participants (2)
-
Düben, Christian -
Thomas Krichel