robots.txt is a bit like asking bots to not visit my site; with .htaccess, you’re not asking

Extra fun nginx thing: don’t use 403, use 444.

That’s a nginx special response that doesn’t actually send anything back, it just drops the connection and moves on.

My robots.txt has definitely only partially helped. I’ll have to see if I can do the same with my Caddy setup.