What is GPTBot?

What does GPTBot do with your content?

Collects pages to train ChatGPT's underlying models. Like most AI crawlers, GPTBot reads your pages as plain HTML — it does not run JavaScript — so content that only appears after scripts execute is invisible to it.

Should you block GPTBot?

This is a genuine trade-off. Allowing GPTBot lets future OpenAI models learn your business exists — useful when customers ask those models for recommendations. Blocking it keeps your content out of training data at the cost of that future visibility. Neither answer is wrong; it depends on what you value more.

How do you allow or block GPTBot in robots.txt?

Add one of these snippets to the robots.txt file at the root of your site. The first explicitly allows GPTBot everywhere; the second blocks it completely.

# Allow GPTBot
User-agent: GPTBot
Allow: /

# Block GPTBot
User-agent: GPTBot
Disallow: /

Is robots.txt enough?

Not always. CDNs and firewalls (Cloudflare in particular) can block crawlers at the network level regardless of what robots.txt says — Cloudflare blocks AI crawlers by default for many accounts. If you want GPTBot to reach your site, check your CDN's bot settings too. SeeGeo's free audit checks both.

What is GPTBot?

GPTBot is OpenAI's AI training crawler. Collects pages to train ChatGPT's underlying models.

Should I block GPTBot?

This is a genuine trade-off. Allowing GPTBot lets future OpenAI models learn your business exists — useful when customers ask those models for recommendations.

Does GPTBot run JavaScript?

No. GPTBot, like most AI crawlers, reads raw HTML without executing JavaScript. If your content only renders client-side, it is effectively invisible to it.