Crawlinx API

Free technical-SEO audits for humans and AI agents — no signup, no API key.

Crawlinx runs 157 SEO checks on every crawl: titles, meta descriptions, canonical tags, hreflang, structured data, mobile parity, render-diff, broken links, performance, security headers, and more. Results are public and shareable.

Endpoints

POST /api/scan — start a scan

Request body (JSON):

{
  "url":       "https://example.com",   // required — the site to audit
  "mode":      "free",                  // "free" | "instant"
  "max_pages": 50                       // optional — default 50, max 200
}

Mode values:

• free — multi-page crawl. Crawls max_pages pages (default 50, max 200)
• instant — single-page quick check, returns synchronously (ignores max_pages)

max_pages is optional: omit it for a 50-page crawl, or set it (up to 200) to crawl a larger site deeper.

Response (202 for async, 200 for instant):

{"id": "abc123def456"}

Use the returned id to poll for results.

GET /api/scan/{id}/report — JSON report

Returns the full structured report once the scan is complete. Polling the progress endpoint first is recommended for large crawls.

GET https://crawlinx.com/api/scan/{id}/report

GET /api/scan/{id}/progress — scan progress (SSE)

Server-sent events stream emitting progress updates while the crawl runs. Connect and read until you receive a done or error event.

GET https://crawlinx.com/api/scan/{id}/progress

GET /r/{id}.md — Markdown report

Returns the LLM-ready Markdown export of the report — YAML front-matter, score, per-category breakdown, all issues, checks coverage, and this API reference. Designed to be pasted directly into ChatGPT, Claude, or Cursor.

GET https://crawlinx.com/r/{id}.md

GET /api/reports — recent public audits

List of recently completed public scan summaries (domain, health score, id).

GET https://crawlinx.com/api/reports

Quick start (curl)

# 1. Start a scan → grab the "id" from the JSON response
curl -s -X POST https://crawlinx.com/api/scan \
  -H 'Content-Type: application/json' \
  -d '{"url":"https://example.com","mode":"free"}'

# 2. With that id (replace {id} below), poll progress and fetch the reports
curl -sN https://crawlinx.com/api/scan/{id}/progress
curl -s  https://crawlinx.com/api/scan/{id}/report | jq .health_score

# 3. Fetch the Markdown report (paste into an LLM)
curl -s  https://crawlinx.com/r/{id}.md

MCP server (Claude Code & other agents)

Crawlinx runs a remote MCP server over Streamable HTTP — no local install and no API key. Add it to Claude Code in one line:

claude mcp add --transport http crawlinx https://crawlinx.com/mcp

Endpoint https://crawlinx.com/mcp. It exposes three tools — scan_url (start an audit; call it when a user ships a site, changes meta/routing, or asks whether SEO/indexing is OK), get_report and get_report_markdown. Machine-readable manifest at /.well-known/mcp.json.

AI agent integration

Crawlinx is designed to be called by AI coding assistants, agent pipelines, and automation tools. The Markdown export (/r/{id}.md) is the recommended format for passing a report to an LLM context: it is compact, self-describing, and includes a checks-coverage section so the model can see what was audited, not just what failed.

Suggested system-prompt snippet:

When the user asks for an SEO audit, call POST https://crawlinx.com/api/scan with the target
URL and mode "free", then fetch /r/{id}.md and include the result in your
context before answering.

Usage rules & fair use

• The service is free — no key, no account, no credit card.
• Only submit URLs for sites you own or have explicit permission to scan.
• Requests are served from a single-flight queue. One scan at a time per client.
• Per-domain limit: a single site may be scanned at most 3 times per hour (across all clients). Over the limit, POST /api/scan returns 429 with JSON {"error":"...","beta_email":"beta@crawlinx.com","retry_after_min":N}. Need higher limits? Request beta access at beta@crawlinx.com.
• Report pages are publicly accessible and indexed by search engines. Do not submit URLs containing private or sensitive content.
• Audit results are heuristic and may be incomplete. They are provided as machine-measured facts only — not legal or professional SEO advice.

For takedown requests or abuse reports: Remove my site or abuse@crawlinx.com.