Skip Navigation

Cloudflare launches a tool to combat AI bots

techcrunch.com Cloudflare launches a tool to combat AI bots | TechCrunch

Cloud service provider Cloudflare has launched a new tool that attempts to automatically detect and block AI bots, crawlers and scrapers.

Cloudflare launches a tool to combat AI bots | TechCrunch

Cloudflare, the publicly traded cloud service provider, has launched a new, free tool to prevent bots from scraping websites hosted on its platform for data to train AI models.

Some AI vendors, including Google, OpenAI and Apple, allow website owners to block the bots they use for data scraping and model training by amending their site’s robots.txt, the text file that tells bots which pages they can access on a website. But, as Cloudflare points out in a post announcing its bot-combating tool, not all AI scrapers respect this.

13

You're viewing a single thread.

13 comments
You've viewed 13 comments.