14 May
2023
14 May
'23
9:45 p.m.
Thomas Krichel writes
Lars Vilhuber writes
User-agent: PetalBot Disallow: /
This is done, but it does not help.
And they just read the location 114.119.151.113 - - [14/May/2023:21:24:42 +0000] "GET /robots.txt HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot)" but don't stop. -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21163rd day.