Making AI search smarter

Starting September 15, Cloudflare defaults blocking mixed-use crawlers on ad pages while launching a new Pay Per Use model. Site owners earn revenue when their content appears in answers rather than just being crawled. The initiative targets answer engines like You.com and Ceramic.ai by sharing freshness signals to reduce unnecessary crawling costs.