NostoCrawlerBot
GoodBotVerifiedBOTMozilla/5.0 (compatible; NostoCrawlerBot/1.0; +http://my.nosto.com/tagging) Operated by Nosto.
What is NostoCrawlerBot?
NostoCrawlerBot is a web crawler operated by Nosto. Mozilla/5.0 (compatible; NostoCrawlerBot/1.0; +http://my.nosto.com/tagging)
Identification
NostoCrawlerBotWhy it crawls your site
NostoCrawlerBot crawls websites to collect data for advertising and marketing purposes. It is operated by Nosto as part of their advertising infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.
Block or allow NostoCrawlerBot
Add a Disallow rule for NostoCrawlerBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block NostoCrawlerBot from crawling your entire site User-agent: NostoCrawlerBot Disallow: / # Allow NostoCrawlerBot full access User-agent: NostoCrawlerBot Allow: /
Ensure your robots.txt allows NostoCrawlerBot. Verify requests are genuine by checking the user-agent string and referring to Nosto's documentation.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.