Directory/Categories/AI Crawler/Amazon Kendra

Amazon Kendra

Name: Amazon Kendra
Author: Amazon

GoodBotVerifiedBOT

Amazon Kendra is a highly accurate intelligent search service that enables your users to search unstructured data using natural language. It returns specific answers to questions, giving users an experience that's close to interacting with a human expert. It is highly scalable and capable of meeting performance demands, tightly integrated with other AWS services such as Amazon S3 and Amazon Lex, and offers enterprise-grade security. Operated by Amazon.

Operator website ↗

GoodBot

Assessment

AI Crawler

What is Amazon Kendra?

Amazon Kendra is an intelligent search service provided by Amazon Web Services (AWS). It employs web crawlers to ingest and index content from various data sources, including public websites and internal company resources. Kendra utilizes natural language processing to enable users to search unstructured data and receive contextual search results, improving the overall search experience.

Helpful — Kendra indexes web content to improve search capabilities for its users.

Identification

Bot name

Amazon Kendra

Operator

Amazon

Why it crawls your site

Amazon Kendra crawls websites to index their content and make it searchable within the Kendra search service. This allows AWS customers to provide their users with a comprehensive search experience across a variety of data sources. The indexed data is used to answer user queries in natural language. You can verify the crawler by checking the User-Agent string and confirming that the requests originate from Amazon AWS infrastructure.

Block or allow Amazon Kendra

Block it

Add a Disallow rule for amazon-kendra- in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block Amazon Kendra from crawling your entire site
User-agent: amazon-kendra-
Disallow: /

# Allow Amazon Kendra full access
User-agent: amazon-kendra-
Allow: /