Noibu Accessibility Crawler
GoodBotVerifiedBOTA specialized crawler operated by Noibu to audit websites for accessibility compliance and technical performance issues. Operated by Noibu.
What is Noibu Accessibility Crawler?
Noibu Accessibility Crawler is an automated agent developed by Noibu, a digital experience monitoring platform. It is designed to navigate websites to identify accessibility barriers, broken elements, and technical friction points that could impact user experience. By simulating user interactions, the bot helps businesses ensure their digital storefronts meet WCAG standards and function correctly across various environments.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- I wonder if it will actually respect the robots.txt this time. | Hacker News
- google ignoring robots.txt ? - Google Search Central Community
- A new web crawler launched by Meta last month is quietly scraping the internet for AI training data
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
Why it crawls your site
The bot crawls websites to gather data for Noibu's monitoring dashboard, which provides site owners with actionable insights into accessibility compliance and technical health. It operates on behalf of the site owner to proactively detect issues before they affect real customers. Operators can verify the bot by checking for the specific 'Noibu Accessibility Crawler' user-agent string in their server logs and ensuring the traffic originates from Noibu's known infrastructure.
Block or allow Noibu Accessibility Crawler
Add a Disallow rule for Noibu Accessibility Crawler in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Noibu Accessibility Crawler from crawling your entire site User-agent: Noibu Accessibility Crawler Disallow: / # Allow Noibu Accessibility Crawler full access User-agent: Noibu Accessibility Crawler Allow: /
Ensure your robots.txt allows Noibu Accessibility Crawler. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction