Cloudflare has a system called AI Labyrinth to fight against AI crawlers ignoring web recommended guidelines (Nofollow tag) and crawl without permission, is there any European alternative to Cloudflare with a similar mechanism to fight against AI crawlers?
I’ve got one! It’s not a trap, but the opposite, which is what many people use Cloudflare for: to protect your web server against the load of LLM scrapers.
It’s called “the nuclear option” because it keeps out all bots, including good ones from search, internet archive, etc.
https://github.com/TecharoHQ/anubis