AISiliconANGLEabout 3 hours ago
Big Tech Backs New AI Opt-Out Standard
3 min read
Google, Microsoft, Anthropic, and OpenAI announced plans to support a new website crawling standard that simplifies blocking AI training data. This update allows operators to block all scrapers with a single robots.txt entry, addressing the current need for multiple edits per provider.
Level
Hype check
Tap to vote and see what everyone thinks.
