Google Lighthouse 13.5 rolls out audit for AI agent resource discovery

Cloudflare launched Bot Preference Sync, allowing sites to set AI crawler access policies by category rather than managing individual crawlers in robots.txt.

Cloudflare introduced a Disallow AI Training option that blocks AI crawlers from training data while preserving access for Googlebot and other search engines.

Google is testing new ad metrics—Ad Count, Ad Density, Ad Weight (Network), and Ad Weight (CPU)—in CrUX to measure page ad impact.

Google's John Mueller addressed an SEO technique using sitemaps to force daily crawling, explaining why the approach doesn't work as intended.