AITechRadarabout 1 hour ago
Google Microsoft Join OpenAI Robots.txt Standard
6 min read
Google and Microsoft join OpenAI and Anthropic to honor a new robots.txt group for AI training opt-outs starting in 2027. Microsoft begins on February 1, 2027, while Google targets 2027. Anthropic already implements it, though the draft lapses May 3, 2027, unless revised. The signal governs content use rather than crawling access, leaving existing scrapes untouched.
Level
Hype check
Tap to vote and see what everyone thinks.
