30 Jul
2023
30 Jul
'23
12:09 p.m.
Thomas Krichel writes
Now I will reboot helos.
Reboot is a succes but bytespider is still there. krichel@trabbi~$ GET https://collec.repec.org/robots.txt # makes requests faster than we can handle User-agent: Bytespider Disallow: / # Crawl-delay: 10 -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21240th day.