AI Search

GoodBotVerifiedAI SearchBOT

Operated by Cloudflare Docs

What is AI Search?

Generated from Cloudflare, operator docs, and community data

Cloudflare AI Search is a crawler operated by Cloudflare to gather data for its AI-driven search capabilities. The bot identifies itself clearly via its user-agent string. It is designed to systematically explore and index web content, enabling Cloudflare to provide more accurate and relevant search results to its users.

Helpful — Indexes web content to improve search functionality.

Details

Bot Name
AI Search
Slug
cloudflare-ai-search
Kind
BOT
Verification
Verified by Cloudflare
Category
AI Search
Operator
Cloudflare

User-Agent Patterns

Cloudflare-AI-Search

Full User-Agent Strings

Cloudflare-AI-Search (https://developers.cloudflare.com/ai-search; [email protected])

Main Use Cases

Indexing web pagesTraining AI modelsImproving search relevance

Why It Crawls Your Site

Cloudflare AI Search crawls the web to build a comprehensive index of online content, which is then used to train and refine its AI search algorithms. By analyzing the structure and content of web pages, the bot helps Cloudflare understand the relationships between different pieces of information and improve the overall quality of its search results. Website owners can verify Cloudflare's ownership of the bot through their published bot list and by confirming the user-agent string.

How to Block / Whitelist

Block AI Search

Add a Disallow rule for Cloudflare-AI-Search in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block AI Search from crawling your entire site
User-agent: Cloudflare-AI-Search
Disallow: /

# Allow AI Search full access
User-agent: Cloudflare-AI-Search
Allow: /

Whitelist AI Search

Ensure your robots.txt allows Cloudflare-AI-Search. Verify requests are genuine by checking the user-agent string and referring to Cloudflare's documentation.

Related Bots from Cloudflare

Other crawlers operated by Cloudflare

BushbabyBushbaby is an internal bot used by Cloudflare. Its purpose is to manage and renew SSL certificates for websites that use Cloudflare's services.SecurityCloudflare Browser RunRenders web pages in headless browsers for Cloudflare customers. Used for browser automation (screenshots, PDF generation, content extraction, etc.) and for AI agents to interact with the web. Used by Cloudflare customers via Workers bindings and REST API. Does not include the /crawl endpoint, which has a separate bot identity (Cloudflare Crawler - Signed Agent).AI AssistantCloudflare CSUPCloudflare CSUP is a bot used by Cloudflare's customer support for diagnostic purposes. It is not a general web crawler and is used to investigate technical issues with customer websites. OtherCloudflare CrawlerThe Cloudflare Crawler is a well-behaved crawler that retrieves web content. By default, it self-identifies as a bot, honors robots.txt directives, and cannot bypass CAPTCHAs or bot protection. Used by Cloudflare customers via the Browser Run /crawl endpoint.AI CrawlerCloudflare Custom Error Page CrawlerCloulflare internal service that crawls customer error pages in order to serve them directly from our edge network.SEOCloudflare CustomerSLO ProberA service to verify the identity of Cloudflare-internal Customer SLO probesMonitoring & AnalyticsCloudflare DiagnosticsCloudflare system bot that performs health checks and diagnostic testsMonitoring & AnalyticsCloudflare Digicert DCVCloudflare Digicert DCV service.SEO

Traffic & Trends

Cloudflare Radar Traffic

No Cloudflare traffic data available

Google Trends Interest

Links & References

Cloudflare Documentation

developers.cloudflare.com/ai-search

Cloudflare Radar: AI Search

radar.cloudflare.com/traffic/bots/cloudflare-ai-search

Data Sources

This profile was compiled from the following sources:

CloudflareRadar

Last updated: May 26, 2026