Catalog/robots.txt blocks AI search/citation crawlers/Category/media
SEO issue · media

robots.txt blocks AI search/citation crawlers: media Category

1 media sites exhibit the "robots.txt blocks AI search/citation crawlers" issue in our audits.

1
media sites affected
Affected sites
Site
theverge.com
Related
theverge.com Catalog robots.txt blocks AI search/citation crawlers Category

Audit your own site — free

77 checks, internal PageRank, render-diff. No signup, results in ~30s.

Scan your site →