amazon-QBusiness
Amazon · Unconfirmed · robots.txt: Yes
Crawls and indexes the websites an Amazon Q Business customer connects, so that company's generative-AI assistant can answer questions from them.
Block amazon-QBusiness
User-agent: amazon-QBusiness
Disallow: /Amazon says a Disallow for amazon-QBusiness stops the Amazon Q Web Crawler from indexing your website.
Allow amazon-QBusiness
User-agent: amazon-QBusiness
Allow: /An allow group only changes anything if a broader rule would block amazon-QBusiness. Under the robots.txt standard (RFC 9309, section 2.2.1) a crawler follows the group that names it and uses the User-agent: * group only when no group does — so this group lets it in even if your * group says Disallow: /. Token matching is case-insensitive.
Put these lines in /robots.txt at the root of each host (each subdomain has its own file). robots.txt is a request to well-behaved crawlers, not access control.
Already have a robots.txt? Paste it into the robots.txt checker to see whether it blocks amazon-QBusiness on a given path, and which line decides.
Who blocks it
amazon-QBusiness is not in the 2026-10-09 survey: it was added to this directory after we last read the most-visited sites' robots.txt files, so we have no count for it yet.
Facts
- Operator
- Amazon
- Purpose
- Unconfirmed by the operator
Amazon documents it as the web crawler of Amazon Q Business, a generative-AI assistant a company configures to answer questions from its own enterprise data; the crawler indexes the websites that company connects. That is none of training, a public AI search index or a user fetch as Amazon states it. Amazon also says Q Business is no longer open to new customers.
- Obeys robots.txt
- Yes. Amazon says the Q Business Web Crawler adheres to the rules in your website's robots.txt, including Allow and Disallow, and gives User-agent: amazon-QBusiness with Disallow: / as the way to stop it crawling a site.
- In your server logs
- Unconfirmed by the operator Amazon's documentation we checked does not give its user-agent string.
- How to verify it
- Unconfirmed by the operator Amazon's documentation we checked gives no IP list or DNS check for this crawler, so a request claiming to be amazon-QBusiness cannot be verified against the operator.
What Amazon says
Quoted word for word from the operator's documentation.
“To stop Amazon Q Web Crawler from crawling the website, use the following directive: User-agent: amazon-QBusiness # Amazon Q Web Crawler Disallow: / # disallow access to any pages”
“Amazon Q Business Web Crawler adheres to the rules set in your website’s robots.txt file, which determines the areas it is allowed or not allowed to visit.”
“Amazon Q Business Web Crawler respects standard robots.txt directives like Allow and Disallow.”
“You can stop Amazon Q Web Crawler from indexing your website using the Disallow directive.”
“Amazon Q Business is no longer open to new customers.”
“Amazon Q Business is a fully managed, generative-AI powered assistant that you can configure to answer questions, provide summaries, generate content, and complete tasks based on your enterprise data.”
Sources
- Amazon Q Business User Guide: Configuring a robots.txt file for Amazon Q Business Web Crawler — fetched and checked 2026-10-09
- Amazon Q Business User Guide: What is Amazon Q Business? — fetched and checked 2026-10-09