Skip to content
Khepri Digital

Free AI readiness checker: Can ChatGPT read your website?

The major AI crawlers read your HTML as it arrives and never run JavaScript. See whether they're allowed in, whether your homepage arrives with its text, and whether they can verify your business.

Free, no sign-up. We read your homepage and robots.txt the way AI crawlers do, without running JavaScript. Takes about 10 seconds.

What we check

Six things AI needs before it can cite you.

Each one is a reason we've seen AI skip a site that should have been in the answer.

  • AI crawlers in robots.txt

    Whether OAI-SearchBot (ChatGPT search), Googlebot, Bingbot, PerplexityBot and Claude-SearchBot may crawl your homepage. Blocking GPTBot or ClaudeBot only opts you out of training; we show it, but don't count it against you.

  • Firewall and bot blocking

    Whether your server or CDN turns away a request that identifies as GPTBot while serving normal visitors. robots.txt can allow a crawler that the firewall still blocks.

  • Text in the HTML

    How much text arrives in the HTML before any JavaScript runs. A Next.js, React or Vue app that renders only in the browser sends an empty page, and that empty page is what most AI crawlers read.

  • Indexing, title and headings

    noindex tags, the page title and description, the main heading, the page language and the canonical address.

  • Structured data and business details

    Whether your JSON-LD is valid and describes your business, and whether its phone number matches the one on the page.

  • Sitemap

    Whether crawlers can find a list of your pages.

Sources: Vercel and MERJ, The rise of the AI crawler · OpenAI crawlers · Anthropic crawlers · Perplexity crawlers · Google AI features

FAQ

AI readiness: questions, answered.

Anything else, ask us on the call or on WhatsApp.

Do AI crawlers run JavaScript?

The major ones don't. Vercel and MERJ studied AI crawler traffic and found that none of the major AI crawlers they tested render JavaScript, including OpenAI's GPTBot, OAI-SearchBot and ChatGPT-User and Anthropic's ClaudeBot. They download the HTML, so anything your page adds with JavaScript after it loads is invisible to them. Google's crawlers do render JavaScript.

Why does my Next.js or React site fail the HTML check?

Because the page's text is drawn in the browser. In Next.js that usually means "use client" at the top of the page, or text fetched in useEffect. Render the page on the server instead, with Server Components or static generation, and check again: the words should then be in the HTML.

Should I block GPTBot?

That's your choice. GPTBot collects training data. ChatGPT search uses OAI-SearchBot, and OpenAI says sites that block OAI-SearchBot aren't shown in ChatGPT search answers. Blocking GPTBot alone doesn't remove you from them. The same split applies to Anthropic: ClaudeBot trains, Claude-SearchBot indexes for search.

Do I need an llms.txt file?

No. Google says you don't need new machine-readable files or markup to appear in AI Overviews or AI Mode, and in our audit of 12 hotels, 10 had no llms.txt and the two that had one were broken, yet 9 of the 10 we tested were named in AI answers. We don't check for it.

If my site passes, will ChatGPT recommend us?

Not by itself. This checks that AI can read your site. Whether AI recommends you depends on what other sites say about you: reviews, press, directories and videos. That's what our AI search visibility work measures and improves.

What do you do with the website I enter?

We fetch its homepage, robots.txt and sitemap once, the way a crawler would, and show you the results. We count checks in Google Analytics by domain. If you ask for the written report, your name and email come to our team with your results.

Book a strategy call