Does crawl-to-refer mean that for every 40k pages ClaudeBot crawls, only 1 outbo... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		AlienRobot 4 months ago \| parent \| context \| favorite \| on: Cloudflare Radar: AI Insights Does crawl-to-refer mean that for every 40k pages ClaudeBot crawls, only 1 outbound link is clicked from it?

avarun 4 months ago | [–]

Claude has an order of magnitude fewer users on its web product while training models that are just as large and advanced as OpenAI, so this makes sense.

johng 4 months ago | [–]

Yes, that's exactly what it means.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact