About

About aicrawlcheck

A free, open validator for whether AI crawlers can read and cite your site.

Answer engines — ChatGPT Search, Perplexity, Google AI Overviews, Claude — fetch web pages to cite them. The single most common way sites accidentally vanish from AI answers is a robots.txt that blocks the engines’ user-agents, often via a copy-pasted “block AI bots” snippet or a blanket Disallow: /. aicrawlcheck tests every major AI crawler against your robots.txt with a correct matcher, validates your llms.txt, and checks on-page AI-readiness signals (structured data, FAQ schema, headings, content depth, freshness).

It is deliberately narrow and honest: a focused AI-crawler + llms.txt validator, not another black-box “GEO score”. Every rule is published in the methodology, results are concrete pass/warning/issue facts, and there is no fake predictive metric.

It runs on Cloudflare — a small serverless function fetches only public http(s) URLs, with private/loopback/ metadata addresses blocked, redirects re-validated, and responses capped. No accounts, and we keep no logs of the URLs you check.

Built for developers, founders and SEO/GEO folks making sure their content is reachable by AI. Run a check →