AI Search External
GoodBotVerifiedBOTCloudflare AI Search is a managed service that lets you connect your data and easily build AI-powered search. Operated by Cloudflare.
Identification
Cloudflare-AI-Search-ExternalHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Bot or Not: Navigating the New World of AI Content Crawlers
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- I wonder if it will actually respect the robots.txt this time. - Hacker News
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- AI Is Killing the Grand Bargain at the Heart of the Web - Business Insider
Block or allow AI Search External
Add a Disallow rule for Cloudflare-AI-Search-External in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block AI Search External from crawling your entire site User-agent: Cloudflare-AI-Search-External Disallow: / # Allow AI Search External full access User-agent: Cloudflare-AI-Search-External Allow: /
Ensure your robots.txt allows Cloudflare-AI-Search-External. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Related bots
Other crawlers operated by Cloudflare.
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction