Source-backed crawler reference
Applebot-Extended Robots.txt Reference
Apple control token for use of web content in certain generative AI models.
Last verified:
Documented role and policy effect
Apple documents Applebot-Extended separately from normal Applebot search crawling.
Model-use controls and search crawling should be reviewed as separate policy decisions.
How to interpret a robots.txt result
An allow result means the matched robots.txt directive does not block this compliant crawler on the tested path. It does not guarantee a visit, indexing, inclusion, ranking, or citation. A block is a public crawler directive, not authentication or access control.
Recommended action: Set the policy according to your content-use intent and verify current Apple documentation.
Official source
Apple documentation for Applebot-Extended
See the AI Index Check methodology for verification, scoring, limitations, and correction policy.