Cloudflare Agent Readiness

Cloudflare Agent Readiness is a diagnostic scanner designed to help website owners understand how well their sites are prepared for interaction with AI agents. Unlike traditional crawlers, it does not index content, train models, or perform recursive scraping. Instead, it performs targeted, on-demand checks of standards like robots.txt and discovery metadata to provide site owners with a readiness score and actionable configuration guidance.

The scanner operates exclusively on-demand when a Cloudflare customer initiates a scan through the dashboard to audit their own property. It performs a limited set of requests to verify that a site correctly implements discovery and access control standards. By using Web Bot Auth, Cloudflare ensures that these diagnostic requests are verifiable and transparent to the domain owner, distinguishing them from unauthorized automated traffic.