AIThe Vergeabout 1 hour ago
Big AI Firms Back New Scraping Opt-Out
2 min read
OpenAI, Google, Microsoft, and Anthropic agree to adopt a new standard allowing publishers to opt out of AI scraping. The shared policy token signal lives within a website's robots.txt file. Microsoft offers granular controls for training or grounding, while Google and Microsoft plan support next year and OpenAI implements it in coming months.
Level
Hype check
Tap to vote and see what everyone thinks.
