Optimixed Search News

John Mueller Shares His Experience Testing Markdown for AI Crawlers

45
News

TLDR

John Mueller tested whether AI crawlers actually request markdown from websites and shared his findings.

Optimixed Overview

Optimixed's original report on this story.

In a post on Google's Search Liaison channel, John Mueller shared what he observed when checking whether AI crawlers were actually requesting markdown from his sites, offering practical insight into how AI systems interact with web content for SEO purposes.

Was this useful?
Share

Related articles

75
Analysis

Analysis suggests Google will shift its default from ranked search results to AI-generated answers once ad revenue from AI answer pages matches traditional SERP yields, a transition expected between 2028 and 2030.

AI & Machine Learning in SEOSEO News & Algorithm Updates
55
Research

SE Ranking's analysis of 300,000 domains found limited evidence that LLMs.txt files materially affect AI citation rates.

AI & Machine Learning in SEOAnalytics & MeasurementTools & Platforms
45
News

Google has released its latest Gemini model, Argon 4.

AI & Machine Learning in SEOSEO News & Algorithm Updates
72
Analysis

Semrush's 2026 AI Visibility Index found that brands often rank high for being mentioned in AI answers but low as cited sources—or vice versa—meaning a single visibility score hides which problem needs solving.

AI & Machine Learning in SEOContent & StrategyAnalytics & Measurement