[Microblog] Go ahead and block AI crawlers coryd

Blocking them with robots.txt is good, but if you want great you can block them by those same user agents in your reverse proxy. If one of the AI bot user agents is detected on a request, it immediately returns 444 (an Nginx-specific response code that basically closes the connection immediately and wastes no further processing).

Comment thread with how-to I wrote a while back: https://dubvee.org/comment/2642357

Edit: Goddamnit, OP deleted their account (and that post) and the comment is inaccessible. If you want the how-to, reply, and I'll repost it. Actually, that link *should* work now. I undeleted the post in the database.