Adriel Bettelheim (@abettel.bsky.social)

NEW: Common Crawl, the massive archiver of the web, has gotten cozy with AI companies and is providing paywalled articles for training data. They’re also lying to publishers who have asked for material to be removed. “The robots are people too,” CC’s exec director told us when we asked about this.

loading . . .

The Nonprofit Feeding the Entire Internet to AI Companies Common Crawl claims to provide a public benefit, but it lies to publishers about its activities. https://www.theatlantic.com/technology/2025/11/common-crawl-ai-training-data/684567/?gift=iWa_iB9lkw4UuiWbIbrWGQv84IP0_-K67yuVC013Fx4

848

588