What is Applebot-Extended?
Applebot-Extended is Apple's robots.txt control for AI use of your content, not a crawler. Controls whether Apple may use your content for Apple Intelligence.
What does Applebot-Extended do with your content?
Controls whether Apple may use your content for Apple Intelligence. Applebot-Extended never visits your site itself: Applebot does the fetching, and Applebot-Extended is the robots.txt switch for the AI use of that content.
Should you block Applebot-Extended?
This is a genuine trade-off. Allowing Applebot-Extended lets future Apple models learn your business exists — useful when customers ask those models for recommendations. Blocking it keeps your content out of training data at the cost of that future visibility. Neither answer is wrong; it depends on what you value more.
How do you allow or block Applebot-Extended in robots.txt?
Add one of these snippets to the robots.txt file at the root of your site. The first explicitly allows Applebot-Extended everywhere; the second blocks it completely.
# Allow Applebot-Extended
User-agent: Applebot-Extended
Allow: /
# Block Applebot-Extended
User-agent: Applebot-Extended
Disallow: /Will you see Applebot-Extended in your server logs?
No. Applebot-Extended is a robots.txt token, not a crawler: Apple documents no separate user-agent for it. Pages are fetched by Applebot, and the Applebot-Extended rule only decides whether Apple may use what Applebot collected for AI.
Is robots.txt enough?
Not always. CDNs and firewalls (Cloudflare in particular) can block crawlers at the network level regardless of what robots.txt says — Cloudflare blocks AI crawlers by default for many accounts. If you want Applebot-Extended to reach your site, check your CDN's bot settings too. SeeGeo's free audit checks both.
How do I check whether Applebot-Extended can read my site right now?
Only robots.txt matters here: look for a group naming Applebot-Extended. There is no request to test, because Applebot-Extended never fetches anything; Applebot's access is a separate question, which SeeGeo's free crawler check answers.
How does Applebot-Extended compare to similar crawlers?
Applebot-Extended is one of 17 crawlers the SeeGeo audit checks individually. The closest comparisons:
| Crawler | Operator | Role | Runs JavaScript? |
|---|---|---|---|
| Applebot-Extended | Apple | AI training crawler | n/a (robots.txt token) |
| GPTBot | OpenAI | AI training crawler | No |
| ClaudeBot | Anthropic | AI training crawler | No |
| Google-Extended | AI training crawler | n/a (robots.txt token) | |
| CCBot | Common Crawl | AI training crawler | No |
Why does crawler access matter? The numbers
Crawler access is where AI visibility starts or ends: a blocked crawler can't read you, and an AI that can't read you can't recommend you.
- Visitors arriving from AI assistants convert at roughly 4.4x the rate of traditional organic search on average (Semrush, cross-industry, 2026).
- AI-assistant referrals are still only about 1% of total web traffic — small, but the fastest-growing acquisition channel measured (multiple 2026 studies).
- Adobe Digital Insights (Q1 2026) measured AI-assistant visitors converting 42% better than non-AI traffic — a full reversal from the year before.
- Cloudflare blocks AI crawlers by default for many accounts, so sites are often invisible to AI without anyone having decided to be.
- Content edits alone — statistics, citations, quotable structure — can raise AI visibility on the order of 30–40% (Princeton GEO study, KDD 2024).
Frequently asked questions
What is Applebot-Extended?
Applebot-Extended is Apple's robots.txt control for AI use of your content, not a crawler. Controls whether Apple may use your content for Apple Intelligence.
Should I block Applebot-Extended?
This is a genuine trade-off. Allowing Applebot-Extended lets future Apple models learn your business exists — useful when customers ask those models for recommendations.
Does Applebot-Extended run JavaScript?
The question doesn't apply: Applebot-Extended fetches nothing. Applebot fetches your pages, and the Applebot-Extended token only governs whether Apple may use them for AI.
Can Applebot-Extended read my website?
Applebot-Extended never reads your website: Applebot does. Applebot-Extended is only a robots.txt rule deciding whether Apple may use that content for AI, so check your robots.txt for a group naming it.