Catalog/robots.txt blocks AI search/citation crawlers/CMS/WordPress

SEO issue · WordPress

robots.txt blocks AI search/citation crawlers: WordPress CMS

1 WordPress sites exhibit the "robots.txt blocks AI search/citation crawlers" issue in our audits.

1

WordPress sites affected

Affected sites

Site
theverge.com

Related

theverge.com Catalog robots.txt blocks AI search/citation crawlers CMS

Audit your own site — free

77 checks, internal PageRank, render-diff. No signup, results in ~30s.

Scan your site →