JemmyNow even my personal instance is infested by these AI crawlers
submitted by
Sundraycross-posted from: https://potato-guy.space/post/38825
OP: potatoguy@potato-guy.space
It's impossible, i got this instance to just see lemmy from my own instance, but no, it was slow as hell the whole week, i got new pods, put postgres on a different pod, pictrs on another, etc.
But it was slow as hell. I didn't know what it was until a few hours before now. 500 GETs in a MINUTE by ClaudeBot and GPTBot, wth is this? why? I blocked the user agents, etc, using a blocking extension on NGINX and now it works.
WHY? So google can say that you should eat glass?
Life is now hell, if before at least someone could upload a website, now even that is painfull.
Sorry for the rant.
If anyone wants to create an instance and fill it with AI slop to feed these things with, I'll chip in.