HO
HostSherlock-Crawler
GoodBotVerifiedBOTAnalyses a domain's web, DNS and mail setup for reports on hostsherlock.com. Requests are signed with Web Bot Auth.
Identification
Bot name
HostSherlock-Crawler
Category
Monitoring & Analytics
Kind
BOT
Verification
Verified bot
Cloudflare slug
hostsherlock-crawler
Block or allow HostSherlock-Crawler
Block it
Add a Disallow rule for HostSherlock-Crawler in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block HostSherlock-Crawler from crawling your entire site User-agent: HostSherlock-Crawler Disallow: / # Allow HostSherlock-Crawler full access User-agent: HostSherlock-Crawler Allow: /
Allow & verify
Ensure your robots.txt allows HostSherlock-Crawler. Verify requests by checking the user-agent string.
Traffic & trends
Cloudflare Radar traffic
No Cloudflare traffic data available.
Google Trends interest
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
CloudflareRadar
Last updated October 25, 2026
Something wrong with this entry? Suggest a correction