Reuters and Time block AI bots by default using robots.txt and whitelists of 70 approved bots at Time. Josh London of Reuters said content creation costs require earned access. Time uses ScalePost to manage bot traffic and sees value in AI bot visibility for GEO insights. 30% of AI bot scrapes in Q4 2025 ignored robots.txt rules.
Tap to vote and see what everyone thinks.
Intuned Launches AI Browser Automation Agent
Summary by ByteBrief