KI-Crawler

Jeder Bot, der über Ihre KI-Sichtbarkeit entscheidet

Ob ChatGPT, Claude, Perplexity oder Google Ihr Unternehmen lesen — und empfehlen — können, hängt an einer Handvoll Crawler. Was jeder tut, und ob Sie ihn hereinlassen sollten.

KI-Such-Crawler

OpenAI

OAI-SearchBot

Builds the index behind ChatGPT search — this is the bot that decides if ChatGPT can cite you.

Perplexity

PerplexityBot

Indexes pages for Perplexity's answer engine — Perplexity cites sources on almost every answer.

Amazon

Amazonbot

Feeds Alexa and Amazon's AI answers.

DuckDuckGo

DuckAssistBot

Powers DuckDuckGo's AI-assisted answers.

KI-Abrufer auf Zuruf

OpenAI

ChatGPT-User

Fetches your page live when a ChatGPT user asks about you in a conversation.

Anthropic

Claude-User

Fetches your page live during a Claude conversation.

Perplexity

Perplexity-User

Fetches your page live when a Perplexity user asks.

KI-Trainings-Crawler

OpenAI

GPTBot

Collects pages to train ChatGPT's underlying models.

Anthropic

ClaudeBot

Crawls pages for Claude's models and search index.

Google

Google-Extended

Controls whether Google may train Gemini on your content. Blocking it does NOT affect Google Search or AI Overviews.

Common Crawl

CCBot

Builds a public web archive that many AI companies train models on. Blocking it quietly removes you from future models' knowledge.

ByteDance

Bytespider

Trains ByteDance's models (Doubao).

Apple

Applebot-Extended

Controls whether Apple may use your content for Apple Intelligence.

Meta

Meta-ExternalAgent

Collects pages to train Meta's Llama models.

Such-Crawler

Google

Googlebot

Google's main crawler. Powers Google Search AND the AI Overviews box at the top of results.

Microsoft

Bingbot

Bing's crawler. Also feeds AI assistants that use Bing's index (including parts of ChatGPT's search), so blocking it hurts more than Bing.

Welche davon erreichen Ihre Website tatsächlich? Der kostenlose SeeGeo-Audit prüft Ihre robots.txt gegen jeden Crawler auf dieser Seite — dazu Ihr CDN und das JavaScript-Rendering.

Kostenlosen Audit starten