Cloudflare Agent Readiness
GoodBotVerifiedBOTA diagnostic scanner allowing users to check whether their website is discoverable and usable by AI agents. Operated by Cloudflare.
What is Cloudflare Agent Readiness?
Cloudflare Agent Readiness is a diagnostic scanner designed to help website owners understand how well their sites are prepared for interaction with AI agents. Unlike traditional crawlers, it does not index content, train models, or perform recursive scraping. Instead, it performs targeted, on-demand checks of standards like robots.txt and discovery metadata to provide site owners with a readiness score and actionable configuration guidance.
Identification
Cloudflare-AgentReadinessHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- Introducing the Agent Readiness score. Check to see if your site is ...
- Alternatives to isitagentready.com (Cloudflare's agent-readiness scanner)? : r/AI_Agents
- Bot Preference Sync enabled but no directives appear in robots.txt (Pages - Bot Management - Cloudflare Community
- Some people are defending Perplexity after Cloudflare ‘named and shamed’ it
Why it crawls your site
The scanner operates exclusively on-demand when a Cloudflare customer initiates a scan through the dashboard to audit their own property. It performs a limited set of requests to verify that a site correctly implements discovery and access control standards. By using Web Bot Auth, Cloudflare ensures that these diagnostic requests are verifiable and transparent to the domain owner, distinguishing them from unauthorized automated traffic.
Block or allow Cloudflare Agent Readiness
Add a Disallow rule for Cloudflare-AgentReadiness in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Cloudflare Agent Readiness from crawling your entire site User-agent: Cloudflare-AgentReadiness Disallow: / # Allow Cloudflare Agent Readiness full access User-agent: Cloudflare-AgentReadiness Allow: /
Ensure your robots.txt allows Cloudflare-AgentReadiness. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Related bots
Other crawlers operated by Cloudflare.
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction