AxionReader
GoodBotVerifiedBOTReads public pages and feeds to verify and date the sources Axion Labs' consumer-rights sites cite. Obeys robots.txt. Operated by Axion Labs.
What is AxionReader?
AxionReader is a purpose-built crawler developed by Axion Labs, a small publisher based in the United Kingdom. Unlike large-scale AI scrapers, it is designed specifically to support the integrity of consumer-rights data sites by fetching public web pages and documents to provide verifiable, date-stamped citations. The bot operates with high transparency, utilizing HTTP Message Signatures (RFC 9421) to allow site owners to cryptographically verify the origin of its requests.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Web Robots: baiduspider bad bot ignores robots.txt
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- Google Gemini Notebook Bot Ignores Robots.txt | Savvy Dealer
Why it crawls your site
The bot crawls to ensure that facts published on Axion Labs' network of consumer-rights websites are backed by accurate, timestamped source material. By reading public feeds and documents, it enables the publisher to maintain a transparent audit trail for its content. The operator explicitly states that the data is not used for training AI models or for resale, and they provide a straightforward mechanism for site owners to opt out of future crawls.
Block or allow AxionReader
Add a Disallow rule for AxionReader in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block AxionReader from crawling your entire site User-agent: AxionReader Disallow: / # Allow AxionReader full access User-agent: AxionReader Allow: /
Ensure your robots.txt allows AxionReader. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction