Catalog/robots.txt blocks AI search/citation crawlers/Category/media
SEO issue · media

robots.txt blocks AI search/citation crawlers: media Category

2 media sites exhibit the "robots.txt blocks AI search/citation crawlers" issue in our audits.

2
media sites affected
Affected sites
Site
subastasya.com
theverge.com
Related
subastasya.com theverge.com Catalog robots.txt blocks AI search/citation crawlers Category

Audit your own site — free

157 checks, internal PageRank, render-diff. No signup, results in ~30s.

Scan your site →