Catalog/robots.txt blocks AI search/citation crawlers/CMS/WordPress
SEO issue · WordPress

robots.txt blocks AI search/citation crawlers: WordPress CMS

9 WordPress sites exhibit the "robots.txt blocks AI search/citation crawlers" issue in our audits.

9
WordPress sites affected
Affected sites
Site
adultshopmall.com
animemerchvault.com
autopartsdealhub.com
cookshopus.com
daringfireball.net
gameconsoleboxs.com
pafipckotaburmeso.org
sturgisdevelopment.com
theverge.com
Related
adultshopmall.com animemerchvault.com autopartsdealhub.com cookshopus.com daringfireball.net gameconsoleboxs.com pafipckotaburmeso.org sturgisdevelopment.com theverge.com Catalog robots.txt blocks AI search/citation crawlers CMS

Audit your own site — free

157 checks, internal PageRank, render-diff. No signup, results in ~30s.

Scan your site →