Guides › AI crawlers
How to block Applebot-Extended in robots.txt
Applebot-Extended is a control token that lets you opt out of Apple using content crawled by Applebot to train its foundation models (Apple Intelligence).
Block Applebot-Extended from your whole site
User-agent: Applebot-Extended Disallow: /
Block only part of your site
User-agent: Applebot-Extended Disallow: /blog/ Disallow: /docs/private/
Notes
Like Google-Extended, it doesn't crawl anything itself. Applebot still crawls for Siri and Spotlight search features. Blocking Applebot-Extended doesn't remove you from those, but blocking Applebot would.
A crawler follows only the most specific group that matches its name. If you add a User-agent: Applebot-Extended group, it stops reading your User-agent: * rules entirely. Repeat any rules you still want it to follow inside its own group.
robots.txt is a request, not an access control. Reputable crawlers honour it; to enforce a block, use your CDN or firewall. Changes are usually picked up within about a day, because crawlers cache robots.txt.
Check it
Run your domain through the checker. It shows whether Applebot-Extended and 11 other AI crawlers are allowed or blocked, and which line decides it.