URLertBot
GoodBotVerifiedBOTURLertBot is the automated security scanner for URLert.com Operated by URLert.
What is URLertBot?
URLertBot is the dedicated security scanning agent for the URLert platform, designed to identify and categorize malicious web content. By proactively crawling URLs, it helps maintain a database of threats, including phishing attempts and malware distribution points, to enhance overall internet safety. The bot operates with a focus on transparency, providing clear identification through its User-Agent and offering verifiable reverse DNS lookups for site administrators.
Identification
URLertBotHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
Why it crawls your site
The bot crawls the web to build and maintain a real-time intelligence feed of dangerous websites. Because its primary mission is public safety, it intentionally ignores robots.txt directives to prevent malicious actors from hiding harmful content behind exclusion rules. Site owners can verify the bot's authenticity via reverse DNS resolution to 'bot.urlert.com' or by referencing the operator's published IP ranges.
Block or allow URLertBot
Add a Disallow rule for URLertBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block URLertBot from crawling your entire site User-agent: URLertBot Disallow: / # Allow URLertBot full access User-agent: URLertBot Allow: /
Ensure your robots.txt allows URLertBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction