Directory/Categories/Monitoring & Analytics/AgenticWebCensusBot

AgenticWebCensusBot

GoodBotVerifiedBOT

Measures one page for the Agentic Web Census when someone asks for it. Six signed requests, no crawling, no JavaScript.

Operator website ↗

GoodBot

Assessment

Monitoring & Analytics

Identification

Bot name

AgenticWebCensusBot

Block or allow AgenticWebCensusBot

Block it

Add a Disallow rule for AgenticWebCensusBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block AgenticWebCensusBot from crawling your entire site
User-agent: AgenticWebCensusBot
Disallow: /

# Allow AgenticWebCensusBot full access
User-agent: AgenticWebCensusBot
Allow: /