Optimixed Search News

John Mueller Shares His Experience Testing Markdown for AI Crawlers

45
News

TLDR

John Mueller tested whether AI crawlers actually request markdown from websites and shared his findings.

Optimixed Overview

Optimixed's original report on this story.

In a post on Google's Search Liaison channel, John Mueller shared what he observed when checking whether AI crawlers were actually requesting markdown from his sites, offering practical insight into how AI systems interact with web content for SEO purposes.

Topics:AI & Machine Learning in SEOSEO News & Algorithm Updates
Was this useful?
Share

Related articles

35
Interview

PM Built Claude Workflow That Self-Improves Weekly

Lenny's Newsletter interviews a Melio PM who built a Claude-based system that automates his weekly prep, morning briefs, and self-improvement loops—and scaled it across his team via a Workstation plugin.

AI & Machine Learning in SEOTools & PlatformsContent & Strategy
35
News

Microsoft Now Requires Login for Copilot, Excluding Bing Search

Microsoft now requires all Copilot users to log in, though the restriction doesn't yet apply to Copilot Search answers within Bing.

AI & Machine Learning in SEOSEO News & Algorithm UpdatesTools & Platforms
45
News

Claude vs Claude Code: Different Web Search Behaviors

Search Engine Journal reports that Claude and Claude Code search the web at different rates, prioritize different brands, and direct their agents to different page types.

AI & Machine Learning in SEOSEO News & Algorithm UpdatesTools & Platforms
25
Product announcement

X Offers Free API Credits for Grok Bot Launch

X is distributing free API credits to allow users to experiment with Grok, its AI-powered bot for analyzing account performance.

AI & Machine Learning in SEOTools & PlatformsSocial Media Marketing