Optimixed Search News

Google Refreshes StoreBot Help Doc With Clearer Guidance on Crawler Access and Reprocessing Times

35
News

TLDR

Google updated its StoreBot crawler troubleshooting documentation with clarifications on accessibility, robots.txt, IP blocking, and reprocessing timelines.

Optimixed Overview

Optimixed's original report on this story.

SERoundtable reports that Google has refreshed its help document on fixing StoreBot crawler access issues for in-store product pages. The updated guide includes expanded details on user-agents, robots.txt configuration, IP address blocking, page speed concerns, and reprocessing procedures—notably clarifying that products typically reappear in local inventory ads within 12 to 48 hours once accessibility is restored. The doc also catalogs common crawler-blocking methods merchants may inadvertently employ.

Was this useful?
Share

Related articles

62
Interview

Nick Fox, Google's SVP of Knowledge & Information, told an interviewer that EU regulations forced Google to reduce search quality in ways that made him feel "terrible" and "sad."

SEO News & Algorithm UpdatesAI & Machine Learning in SEOContent & Strategy
35
News

Google is experimenting with a two-row button layout for local search panel actions on mobile devices.

SEO News & Algorithm UpdatesLocal SEOTechnical SEO
35
News

Google Maps is placing some service area business pins in the ocean instead of at correct locations.

SEO News & Algorithm UpdatesLocal SEOTools & Platforms
68
News

Google is challenging an EU Digital Markets Act ruling that would require it to share anonymized search history data with competitors.

SEO News & Algorithm UpdatesAI & Machine Learning in SEOTools & Platforms