AI Bots Are Strip-Mining the Web, and Anthropic Leads the Pack
Cloudflare’s latest data offers one of the clearest snapshots yet of how AI companies consume the web, and how little they give back. Loading audio narration… The company, which powers roughly 20% of the internet, tracks how AI bots crawl websites versus how often those platforms send users back through referrals. The resulting “crawl-to-refer” ratio…