AI crawlers

What is Applebot-Extended?

Applebot-Extended is Apple's AI training crawler. Controls whether Apple may use your content for Apple Intelligence.

What does Applebot-Extended do with your content?

Controls whether Apple may use your content for Apple Intelligence. Like most AI crawlers, Applebot-Extended reads your pages as plain HTML — it does not run JavaScript — so content that only appears after scripts execute is invisible to it.

Should you block Applebot-Extended?

This is a genuine trade-off. Allowing Applebot-Extended lets future Apple models learn your business exists — useful when customers ask those models for recommendations. Blocking it keeps your content out of training data at the cost of that future visibility. Neither answer is wrong; it depends on what you value more.

How do you allow or block Applebot-Extended in robots.txt?

Add one of these snippets to the robots.txt file at the root of your site. The first explicitly allows Applebot-Extended everywhere; the second blocks it completely.

# Allow Applebot-Extended
User-agent: Applebot-Extended
Allow: /

# Block Applebot-Extended
User-agent: Applebot-Extended
Disallow: /

Is robots.txt enough?

Not always. CDNs and firewalls (Cloudflare in particular) can block crawlers at the network level regardless of what robots.txt says — Cloudflare blocks AI crawlers by default for many accounts. If you want Applebot-Extended to reach your site, check your CDN's bot settings too. SeeGeo's free audit checks both.

Frequently asked questions

What is Applebot-Extended?

Applebot-Extended is Apple's AI training crawler. Controls whether Apple may use your content for Apple Intelligence.

Should I block Applebot-Extended?

This is a genuine trade-off. Allowing Applebot-Extended lets future Apple models learn your business exists — useful when customers ask those models for recommendations.

Does Applebot-Extended run JavaScript?

No. Applebot-Extended, like most AI crawlers, reads raw HTML without executing JavaScript. If your content only renders client-side, it is effectively invisible to it.

Is your site readable to AI right now? SeeGeo's free audit checks crawler access (all 16 bots), structure, and content extractability in about a minute.

Run a free audit

Related