Algolia
GoodBotVerifiedSearch Engine CrawlerBOTOperated by Algolia Docs
What is Algolia?
Generated from Cloudflare, operator docs, and community data
The Algolia Crawler is a web crawler operated by Algolia to index website content. It gathers information from websites to populate Algolia's search index, which powers their AI-driven search and discovery platform. The crawler is a key component of Algolia's service, enabling users to quickly and efficiently find relevant information on websites that utilize Algolia's search technology.
Details
- Bot Name
- Algolia
- Slug
- algolia
- Kind
- BOT
- Verification
- Verified by Cloudflare
- Category
- Search Engine Crawler
- Operator
- Algolia
User-Agent Patterns
Algolia CrawlerFull User-Agent Strings
Main Use Cases
Why It Crawls Your Site
Algolia Crawler crawls websites to index their content and make it searchable through Algolia's search-as-a-service platform. The indexed data is used to provide AI-powered search results, recommendations, and personalized experiences for users on websites that have integrated Algolia. Website owners can verify Algolia's crawler by checking their Algolia dashboard and ensuring the crawler is configured to index their site. More information about Algolia and its services can be found on their website.
How to Block / Whitelist
Block Algolia
Add a Disallow rule for Algolia Crawler in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Algolia from crawling your entire site User-agent: Algolia Crawler Disallow: / # Allow Algolia full access User-agent: Algolia Crawler Allow: /
Whitelist Algolia
Ensure your robots.txt allows Algolia Crawler. Verify requests are genuine by checking the user-agent string and referring to Algolia's documentation.
Traffic & Trends
Cloudflare Radar Traffic
No Cloudflare traffic data available
Google Trends Interest
Links & References
Data Sources
This profile was compiled from the following sources:
Last updated: May 26, 2026