Check my product

7 Free Tools to Check If AI Can Find Your Website

Seven free checks, in order: can AI bots get in, can AI read your pages, can it find your key pages, and does AI actually use you.

By DowseAI18 Nov 20265 min read

When someone asks ChatGPT for “the best tool for X”, a lot has to go right before your product gets named.

The AI’s bot has to be allowed in. It has to read your pages. It has to understand what you sell. And then it has to choose you over everyone else.

Each of those steps can fail on its own. So I made a list of free tools that check each step.

Three of them are DowseAI’s own free tools: the robots.txt checker, the AI readiness checker and the llms.txt checker. The other four are from Google, Microsoft, Cloudflare and HubSpot.

Step 1: Can AI bots get in?

1. Robots.txt checker for AI crawlers

Your robots.txt file tells bots where they can go. One wrong line can keep ChatGPT, Claude or Perplexity out of your whole site.

This tool reads your robots.txt and shows, bot by bot, who’s allowed and who’s blocked. It splits the bots into two groups: the ones that answer questions (like OAI-SearchBot) and the ones that collect training data (like GPTBot). If an answer bot is blocked by mistake, it gives you the lines to add.

Use it for: making sure you didn’t block AI search by accident. Link: dowseai.com/robots-txt-checker

2. Cloudflare AI Crawl Control (if your site is on Cloudflare)

robots.txt is what you ask for. This shows what actually happens: which AI crawlers visit your site and whether they got through.

It’s in your Cloudflare dashboard on every plan, including Free. On the Free plan you see the last 24 hours.

One thing to check while you’re there: since 15 September 2026, new Cloudflare domains block training and agent crawlers by default on pages that show ads. Search crawlers stay allowed. Make sure the setting matches what you want.

Use it for: seeing real AI bot visits, not just your rules.

Step 2: Can AI read your pages?

3. AI readiness checker

This one checks your home page the way a simple AI crawler sees it: the raw HTML, no JavaScript.

It scores nine things out of 100: bot access, real text without JavaScript, noindex, title, description, structured data, main heading, sitemap, and a link to pricing. Then it tells you what to fix first.

Last week I ran it on 50 well-known SaaS sites. Most scored 100. The most common gap was structured data: 12 of 45 had none.

Use it for: a quick overall check of your home page. Link: dowseai.com/ai-readiness-checker

4. Google Rich Results Test

Structured data (JSON-LD) is a small block of code that tells machines your name, what you make and what it costs. Google’s free test reads it and shows any errors.

Use it for: checking your structured data after you add it. Link: search.google.com/test/rich-results

Step 3: Can AI tools find your key pages?

5. llms.txt checker

llms.txt is a plain text file that lists your important pages for AI tools. It’s cheap to add, though no major AI assistant has confirmed it reads them from other sites. 34 of the 50 big SaaS sites I checked have one anyway.

This tool checks if yours exists and is written correctly. If you don’t have one, it drafts one from your home page.

Use it for: adding an llms.txt in a few minutes, or fixing one. Link: dowseai.com/llms-txt

Step 4: Does AI actually use you?

6. Bing Webmaster Tools: AI Performance

This is one of the few places you get real data from an AI assistant. Bing’s free AI Performance report shows how often Microsoft Copilot and Bing’s AI answers cite your pages, and which pages.

It only covers Microsoft’s AI, not ChatGPT or Perplexity. But it’s real numbers, and it’s free once you verify your site.

Use it for: seeing if an AI assistant is citing you at all. Link: bing.com/webmasters

7. HubSpot AI Search Grader

This asks ChatGPT, Perplexity and Gemini about your brand and gives you a score for things like sentiment and share of voice. It’s free, but you fill in a short form to see the full results.

Use it for: a quick first look at how AI sees your brand. Link: hubspot.com/ai-search-grader

A bonus check that needs no tool

Open your home page in Chrome, right-click and choose View page source. Search for your main headline.

If it’s not there, your text is loaded by JavaScript. Many AI crawlers don’t run JavaScript, so they may see an almost empty page.

A quick note

  • Steps 1 to 3 check whether AI can read you. Step 4 is about whether it does.
  • Passing every check doesn’t mean AI will recommend you. It means nothing technical is stopping it.

What none of these show

Most of these tools answer “can AI read my site?” The question that matters for sales is different: when a buyer asks “what’s the best tool for X?”, which products get named, and is yours one of them?

That’s what I built DowseAI for. It shows what ChatGPT, Claude, Gemini and Perplexity tell buyers in your category, who they recommend instead of you, what they get wrong about you, and what to fix. One report, no subscription. (dowseai.com)

FAQ

Which one should I run first? The AI readiness checker. It covers the basics in one go and tells you which of the others you need.

Are these really free? Yes. HubSpot asks for a short form. Bing and Cloudflare need an account, but the reports are free.

I passed everything. Why doesn’t ChatGPT mention me? Because being readable is only the start. AI recommends what it has learned about from across the web: reviews, comparisons, forums and lists. Your site is one source among many.


Run your own site through the free AI readiness checker, or see what AI actually says about your product with a DowseAI report. Questions: hello@dowseai.com.

Sources

DowseAI

Does ChatGPT recommend you?

See what ChatGPT, Claude, Gemini and Perplexity tell buyers about tools like yours, who they name instead of you, and what to fix. $29 once.

  1. 19 Nov 2026

    The 7 Best AI Visibility Tools in 2026, Compared

    Read
  2. 17 Nov 2026

    The New York Times Blocks ChatGPT, Claude and Perplexity. Google Still Gets In.

    Read