Resource

The Nonprofit Feeding the Entire Internet to AI Companies Highlight

posted on in: Quote, media and ai.

—

In the past year, Common Crawl’s CCBot has become the scraper most widely blocked by the top 1,000 websites, surpassing even OpenAI’s GPTBot, which collects content for ChatGPT. However, blocking only prevents future content from being scraped. It doesn’t affect the webpages Common Crawl has already collected and stored in its archives.

— Alex Reisner

Replicated under Fair Use from The Nonprofit Feeding the Entire Internet to AI Companies by Alex Reisner.

Copy this link to share with your friends.

https://aramzs.xyz/resources/quotes/the-nonprofit-feeding-the-entire-internet-to-ai-companies/in-past-year-common-crawls-899d7/