Amazon · Training crawler
Amazonbot
Amazonbot is Amazon's web crawler, used to index content that helps answer user questions through Alexa and Amazon's AI services, and to improve those services. Amazon documents that Amazonbot respects robots.txt and the nofollow and noindex directives. Blocking Amazonbot keeps your content out of Amazon's AI answer surfaces.
Last updated
- User-agent token
- Amazonbot
- Operator
- Amazon
- Feeds
- Alexa & Amazon AI answers
- robots.txt
- Unverified
How to control Amazonbot in robots.txt
Edit the robots.txt file at the root of your domain (for example https://example.com/robots.txt), add one of the groups below, then save and re-deploy.
Remember: a named User-agent: Amazonbot group overrides your global User-agent: * rules, so repeat any private Disallow paths inside it.
Allow Amazonbot (recommended for AI visibility)
# Welcome Amazonbot, but keep private areas blocked.
# A named user-agent group overrides "User-agent: *", so repeat
# your own private Disallow rules inside this group.
User-agent: Amazonbot
Allow: /
Disallow: /admin/
Disallow: /account/
Disallow: /cart/
Disallow: /checkout/
Block Amazonbot
# Block Amazonbot from the entire site.
User-agent: Amazonbot
Disallow: /
FAQ
Does Amazonbot respect robots.txt?
Yes. Amazon states Amazonbot honors robots.txt rules and standard robots meta directives like nofollow and noindex.
What does Amazonbot feed?
Content Amazonbot crawls can be used to answer questions via Alexa and Amazon's AI services and to improve those products.
Is your site visible to AI crawlers?
Run a free AI-visibility audit to see which AI crawlers can reach your content and how often you get cited by ChatGPT, Perplexity, Claude, and Google AI Overviews.
Run a free auditPart of the Cite Hustle AI crawler directory. For the full framework on AI search visibility, read the GEO methodology.