# Crawlinx

> Crawlinx is a free technical-SEO crawler. Give it a URL and it crawls up to 50 pages, runs 79 technical-SEO checks (titles, meta, canonicals, hreflang, structured data, mobile parity, render-diff, broken links, internal PageRank, near-duplicate clusters and more) and returns a shareable report. No signup, no API key. Findings are never gated.

This file follows the llms.txt convention: it is meant for LLMs and AI agents. Every report is also available as clean Markdown for direct consumption.

## Use it programmatically

- Start a scan: `POST https://crawlinx.com/api/scan` with JSON `{"url":"https://example.com","mode":"free"}` → returns `{"id":"<scanID>"}`.
- Any report as Markdown (LLM-ready): `GET https://crawlinx.com/r/{scanID}.md` or `GET https://crawlinx.com/audit/{domain}.md`.
- Report JSON: `GET https://crawlinx.com/api/scan/{scanID}/report`. Recent public audits: `GET https://crawlinx.com/api/reports`.
- Full API & agent docs: [https://crawlinx.com/api](https://crawlinx.com/api). MCP server exposes tools scan_url / get_report / get_report_markdown.

## Key pages

- [Catalog](https://crawlinx.com/catalog): every audited site, browsable and grouped by CMS, industry and more (220 sites audited so far).
- [Benchmarks](https://crawlinx.com/benchmarks): median SEO health and page counts across the corpus, sliced by platform.
- [SEO issues](https://crawlinx.com/seo-issues): each technical-SEO issue explained — what it is, how common it is, how to fix it.
- [API & agent docs](https://crawlinx.com/api): endpoints, rules and MCP integration.

## Stay updated

- RSS feed of the latest audits: [https://crawlinx.com/feed.xml](https://crawlinx.com/feed.xml).
- Sitemap: https://crawlinx.com/sitemap.xml

## Notes for agents

- Only scan sites you own or are authorized to scan (see https://crawlinx.com/terms).
- Scores are a transparent severity-weighted health score (0-100); the report lists every finding by severity with exact URLs.