BellezaCheckBot
GoodBotVerifiedBOTA specialized crawler for the Chilean cosmetics price comparison platform BellezaCheck, designed to index product pricing and availability data. Operated by BellezaCheck.
What is BellezaCheckBot?
BellezaCheckBot is the official web crawler for BellezaCheck, a Chilean price comparison engine focused on the cosmetics market. The bot systematically visits e-commerce sites to extract product pricing and availability information, which is then displayed to users to facilitate informed purchasing decisions. It is designed with a focus on site performance, employing conservative crawl rates and strict adherence to robots.txt directives to ensure it does not negatively impact the host servers.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Web Robots: baiduspider bad bot ignores robots.txt
- Google Just Renamed a Bot That Ignores Your Robots.txt. Your Dealership Site Has Until August. | Savvy Dealer Blog
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- ChatGPT's Fetch Bot Ignores Robots.txt. Now What?
Why it crawls your site
The bot crawls to maintain an up-to-date database of cosmetic product prices across various Chilean retailers, allowing the platform to provide real-time comparison data. By indexing these pages, it enables the platform to link shoppers directly to the original store's product pages, driving referral traffic to the retailers. Operators can verify the bot's identity through its use of HTTP Message Signatures (RFC 9421) and its adherence to the specified robots.txt protocols.
Block or allow BellezaCheckBot
Add a Disallow rule for BellezaCheckBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block BellezaCheckBot from crawling your entire site User-agent: BellezaCheckBot Disallow: / # Allow BellezaCheckBot full access User-agent: BellezaCheckBot Allow: /
Ensure your robots.txt allows BellezaCheckBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction