Applebot-Extended
Applebot-Extended is a robots.txt control token that lets you opt your content out of being used to train Apple's generative models (Apple Intelligence) and its foundation models. It sits on top of Applebot, the crawler that powers Siri and Spotlight Suggestions: blocking Applebot-Extended stops training use while still letting Applebot index you for Siri and Spotlight. Like Google-Extended, it is a consent token rather than a distinct bot.
Last updated
What does Applebot-Extended do?
- User-agent token
- Applebot-Extended
- Operator
- Apple
- Feeds
- Apple Intelligence training opt-out
- robots.txt
- Unverified
A robots.txt control token layered on top of Applebot. It has no separate user agent or IP range.
How do you control Applebot-Extended in robots.txt?
Edit the robots.txt file at the root of your domain (for example https://example.com/robots.txt), add one of the groups below, then save and re-deploy.
Allow (default, used for training/grounding)
# Welcome Applebot-Extended, but keep private areas blocked.
# A named user-agent group overrides "User-agent: *", so repeat
# your own private Disallow rules inside this group.
User-agent: Applebot-Extended
Allow: /
Disallow: /admin/
Disallow: /account/
Disallow: /cart/
Disallow: /checkout/
Opt out of Applebot-Extended
# Opt out of Applebot-Extended (a robots.txt control token, not a crawler).
User-agent: Applebot-Extended
Disallow: /
FAQ
Does Applebot-Extended stop Siri and Spotlight from using my site?
No. Applebot-Extended only governs generative-model training. Applebot itself continues to crawl your content for Siri and Spotlight Suggestions unless you block Applebot directly.
Is Applebot-Extended a separate crawler?
No. It is a robots.txt control token with no user agent of its own. The crawling is still done by Applebot.
Is your site visible to AI crawlers?
Run a free technical access audit to inspect published crawler controls and raw HTML delivery. It does not measure whether an engine indexed or cited the site.
Run a free auditPart of the Cite Hustle AI crawler directory. For the full framework on AI search visibility, read the GEO methodology.