Quick answer: your website can be completely invisible to ChatGPT, Perplexity, and Gemini even if it ranks fine on Google — and it takes about five minutes to find out. The most common causes are a robots.txt file that blocks AI crawlers (often set by default, not by choice), a security service like Cloudflare silently turning AI bots away, or a site built so heavily on JavaScript that AI crawlers see a blank page. This guide walks you through checking all of it yourself, step by step, with no tools required.
That matters more than it used to. A 2026 study cited by Search Engine Land found that 37% of consumers now begin searches with AI tools rather than traditional search engines, and organic click-through rates for queries that trigger AI summaries have fallen by as much as 61% since mid-2024. If a meaningful slice of your customers is asking ChatGPT "what's the best [your category] near me" — and your site is blocked — you're not losing to competitors. You're not even in the room.
Why would my website be invisible to AI in the first place?
Because AI visibility and Google visibility are controlled by different switches, and most websites only ever flipped the Google one.
Search engines and AI companies each send their own crawler — a bot that reads your site. Google sends Googlebot. OpenAI sends GPTBot. Anthropic sends ClaudeBot. Perplexity sends PerplexityBot. Google's AI training crawler is separate from its search crawler and is called Google-Extended. Your website's robots.txt file (a plain text file that tells bots what they may read) can allow some and block others — and many sites block the AI ones without the owner ever deciding to.
There are three common ways this happens:
- A default you never chose. Cloudflare, which sits in front of a huge share of the web, moved to blocking AI crawlers by default. If your site is behind Cloudflare and nobody actively changed that setting, AI bots may be getting turned away at the door — with your robots.txt looking perfectly innocent.
- A well-meaning past decision. During the 2023–2024 wave of concern about AI companies training on website content, many site owners (or their agencies, or a WordPress plugin) added blanket AI-blocking rules. Reasonable at the time — but the trade has changed: blocking AI crawlers now also means being absent from AI answers your customers actually read.
- A site AI can't read. Some AI crawlers do not run JavaScript. If your site is a JavaScript-heavy single-page app that only shows content after scripts run, an AI crawler can fetch your page and receive, functionally, nothing.
None of these show up in Google Analytics. Traffic looks normal. Rankings look normal. The invisibility is happening in a channel you're not measuring.
How do I check if ChatGPT can see my website? (the 5-minute check)
You need a browser and nothing else. Do these four steps in order.
Step 1: Read your robots.txt (2 minutes)
Type your domain followed by /robots.txt into your browser — for example, yourbusiness.com/robots.txt. You'll see a plain text file. Look for lines mentioning any of these names:
GPTBot(OpenAI / ChatGPT)ClaudeBot(Anthropic / Claude)PerplexityBot(Perplexity)Google-Extended(Google's AI training)CCBot(Common Crawl, a dataset many AI systems learn from)
The pattern that matters looks like this:
User-agent: GPTBot
Disallow: /
That pair of lines means "GPTBot may read nothing." If you see it — or the same pattern for any bot above — that crawler is blocked from your entire site. If none of these names appear at all, the file isn't blocking them (though Step 3 can still be).
Step 2: Ask the AI about your own business (1 minute)
Open ChatGPT (and Perplexity, if you have two spare minutes) and ask the questions a customer would actually ask:
- "What is [your business name]?"
- "Best [your category] in [your city]"
- "Alternatives to [your biggest competitor]"
You're checking three things: Do you appear at all? Is what it says about you accurate? And who appears instead of you? Write down which sources the AI cites — those pages are where AI already looks for answers in your category, and being mentioned on them is one of the fastest visibility wins available.
One caveat: AI answers vary between runs. Not appearing once doesn't prove you're invisible; appearing once doesn't prove you're reliably visible. Treat this as a smoke test, not a measurement.
Step 3: Check whether a security layer is blocking bots (1 minute)
If you know your site uses Cloudflare or a similar service (your web person will know; a quick way to guess is that your DNS is managed there), log into that dashboard and find the bot-management or "AI crawlers" settings. Look for whether AI bots are being blocked at the network level. This is the sneaky one: it overrides whatever your robots.txt politely says, because blocked bots never get far enough to read it.
Step 4: View your site the way a no-JavaScript crawler does (1 minute)
In Chrome: open your homepage, press F12, open the command menu (Ctrl/Cmd+Shift+P), type "Disable JavaScript," select it, and reload the page. Alternatively, use any online "fetch as bot" tool.
Now look at the page. Is your actual content there — your service descriptions, your products, your location — or is it a blank shell with a loading spinner? If the content is gone, AI crawlers that skip JavaScript are seeing that blank version. Your beautiful site is, to them, an empty room.
What do my results mean?
- All four steps look clean: AI systems can at least access you. Whether they choose you is the next battle — that's about how your content is structured, whether it answers questions directly, and how often your brand is mentioned around the web. (That's a different article.)
- Step 1 or 3 showed blocking: you have a critical, fixable problem. Unblocking is usually a one-line robots.txt edit or one dashboard toggle, and it's the single highest-leverage fix in AI visibility because everything else depends on access.
- Step 4 came back blank: you have a rendering problem. Fixes range from enabling server-side rendering to pre-rendering key pages — a developer conversation, but a well-understood one.
- Step 2 showed wrong information about you: AI systems have learned something inaccurate, usually from inconsistent or outdated descriptions of your business across the web. That's an off-site cleanup job: making sure directories, review sites, and your own About page all tell the same story.
Should I just fix the robots.txt and call it done?
Unblocking gets you eligible. It doesn't get you chosen. AI engines cite content that answers questions directly, includes concrete facts and figures, and comes from brands they see mentioned consistently across the web. Research from Princeton on generative engine optimization found that adding statistics and citing sources in your content can improve visibility in AI answers by roughly 30–40% — which is to say, the writing itself is a lever, not just the plumbing.
But plumbing first. There is no version of AI visibility that starts with a blocked crawler.
Check all of this automatically
Everything above, you can do by hand — today, free, no signup. The honest limitation is that it's a snapshot: robots.txt files change, security defaults change, AI models change, and the check you ran in August tells you nothing about November.
That's the gap SeeGeo's free audit covers: it runs this entire check (plus about thirty others across your content structure, schema markup, and off-site mentions) in around 30 seconds, and can keep re-running it so you find out when something breaks — instead of finding out when the leads stop.
Frequently asked questions
How do I know if my website blocks GPTBot?
Visit yourdomain.com/robots.txt and search the page for "GPTBot." If you find User-agent: GPTBot followed by Disallow: /, your site tells OpenAI's crawler to read nothing. Also check your CDN or firewall (like Cloudflare) settings, which can block bots regardless of robots.txt.
Does blocking AI crawlers protect my content? It prevents those specific crawlers from reading your site, which some owners prefer for content-protection reasons. The trade-off in 2026 is real, though: blocked crawlers can't include you in AI answers, and AI answers are where a growing share of customer research happens. It's a legitimate business decision — it should just be a decision, not a default you didn't know about.
Why does ChatGPT say wrong things about my business? Usually because the information about your business across the web is inconsistent, outdated, or thin. AI systems learn from many sources — your site, directories, review platforms, articles. Cleaning up and aligning those descriptions, and publishing a clear plain-language "what we do" statement on your own site, is the standard fix.
Is being visible to ChatGPT the same as ranking on Google? No. They overlap (both reward crawlable sites, clear content, and authority) but diverge in important ways: AI engines lift direct answers rather than listing links, they weigh brand mentions even without hyperlinks, and they can be blocked independently of Google. A site can rank #1 on Google and be entirely absent from AI answers — that combination is exactly what this check detects.
How often should I re-check my AI visibility? Monthly at minimum, and after any site migration, CDN change, or redesign. AI models and crawler policies change frequently enough that quarterly-or-older information in this space is considered stale even by industry reviewers.