Optimixed Search News

Cloudflare's Disallow AI Training feature allows sites to block AI scrapers without excluding Googlebot

65
News

TLDR

Cloudflare introduced a Disallow AI Training option that blocks AI crawlers from training data while preserving access for Googlebot and other search engines.

Optimixed Overview

Optimixed's original report on this story.

Cloudflare's new Disallow AI Training feature keeps mixed-use crawlers available for search indexing while allowing sites to opt out of AI model training. Google and Apple currently honor training opt-outs through this mechanism; Bing support for robots.txt directives in this area is still pending.

Topics:SEO News & Algorithm UpdatesAI & Machine Learning in SEO
Was this useful?
Share

Related articles

55
News

Google Tests Ad Metrics in Chrome User Experience Report

Google is testing new ad metrics—Ad Count, Ad Density, Ad Weight (Network), and Ad Weight (CPU)—in CrUX to measure page ad impact.

Technical SEOSEO News & Algorithm UpdatesAnalytics & Measurement
65
News

Google on Daily-Crawl Sitemap Hack: Why It Backfires

Google's John Mueller addressed an SEO technique using sitemaps to force daily crawling, explaining why the approach doesn't work as intended.

Technical SEOSEO News & Algorithm Updates
55
News

How AI Cyberattacks Are Reshaping Website Security for SEO

Over 100 organizations including OpenAI, Google, and Microsoft are warning website owners to prepare for escalating AI-driven cyberattacks.

Technical SEOSEO News & Algorithm UpdatesAI & Machine Learning in SEO
25
News

Google Lists Supported Favicon Formats in Search Docs

Google's Search documentation now explicitly lists seven favicon file formats it supports (BMP, GIF, ICO, PNG, JPEG, PPM, TIFF).

Technical SEOSEO News & Algorithm Updates