Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Everyone does these days, although its really the AI scrapers you need defence from and Cloudflare isn't doing so good at that yet.


As someone who actually hosts stuff at home, I'm not sure everyone does. I don't, for one

Maybe if you're on a limited data plan (like in Belgium or on mobile data), you'd want to prevent unnecessary pageloads? Afaik that doesn't apply to most home connections

Or if you want to absolutely prevent that LLMs eat your content for moral/copyright reasons, then it can't be on the open internet no matter who your gateway is


ai scrapers are truly this year's boogeyman




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: