AIFast Company Techabout 3 hours ago

AI crawlers nearly killed LGBT history archive

4 min read

Meta and Alibaba crawlers bombarded the LGBT History Project, making 26,000 requests in one day and pulling 12GB of data. Founder Jonathan Harborne doubled server size at personal cost. The site passed 50 million views and is archived by the British Library.

Level

Hype check

Tap to vote and see what everyone thinks.

In this storyMeta