VeritasetBot
GoodBotVerifiedBOTVeritasetBot is a specialized crawler that extracts pricing and plan data from telecom operator websites to provide transparent, independent comparisons for consumers and AI assistants. Operated by Veritaset.
What is VeritasetBot?
VeritasetBot is an automated agent operated by Veritaset, designed to systematically collect public pricing and service plan information from mobile and home internet provider websites. Unlike general-purpose crawlers, it is purpose-built to maintain a database of factual plan details, such as data caps, roaming fees, and contract terms, which are then used to power independent comparison tools and AI-driven consumer services. The bot is highly respectful of site owners, adhering strictly to robots.txt directives and avoiding any attempts to bypass access restrictions.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Web Robots: baiduspider bad bot ignores robots.txt
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- ChatGPT's Fetch Bot Ignores Robots.txt. Now What?
Why it crawls your site
The bot crawls to maintain an up-to-date, accurate repository of telecom market data, ensuring that consumers and AI models have access to verified, dated information rather than stale marketing copy. By extracting only specific plan facts and linking them back to the source, Veritaset aims to provide a neutral, non-commercial ranking of services. Site administrators can verify the bot's intent via its documentation page or by contacting the provided email address, and can easily opt-out by updating their robots.txt file.
Block or allow VeritasetBot
Add a Disallow rule for VeritasetBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block VeritasetBot from crawling your entire site User-agent: VeritasetBot Disallow: / # Allow VeritasetBot full access User-agent: VeritasetBot Allow: /
Ensure your robots.txt allows VeritasetBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction