[CollEc] your hits on https://collec.repec.org

hi PetalBot gang, https://collec.repec.org is a shiny app. Recently it has been overloading the machine. I suspect is your reqests. From what I understand at my last overload, about 90 minutes ago, you made a request with less than 3 seconds delay but my robots.txt had Crawl-delay: 5. I now set it to Disallow: / in an act of dispair. Can we please respect indications in robot.txt? -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21163rd day.