There is no law that says you have to respect robots.txt. It's just a suggestion... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		SeanAnderson 3 months ago \| parent \| context \| favorite \| on: ChatGPT Atlas There is no law that says you have to respect robots.txt. It's just a suggestion.

scoofy 3 months ago [–]

For the websites that ChatGPT wants to scrape -- Reddit immediately comes to mind -- it's not an issue of law, it's an issue of "the infrastructure now exists to prevent you from doing that."

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact