Novellum AI Crawl
GoodBotVerifiedBOTNovellum.ai is building out tools for building agents. This MCP tool will be used by agents to crawl sites. Operated by Novellum.
What is Novellum AI Crawl?
Novellum AI Crawl is a web crawler operated by Novellum. Novellum.ai is building out tools for building agents. This MCP tool will be used by agents to crawl sites. It is part of the growing wave of AI-powered crawlers that collect web data for training and improving AI models.
Identification
NovellumWhy it crawls your site
Novellum AI Crawl crawls websites to collect and process web content for AI model training and improvement. It is operated by Novellum as part of their AI and machine learning infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.
Block or allow Novellum AI Crawl
Add a Disallow rule for Novellum in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Novellum AI Crawl from crawling your entire site User-agent: Novellum Disallow: / # Allow Novellum AI Crawl full access User-agent: Novellum Allow: /
Ensure your robots.txt allows Novellum. Verify requests are genuine by checking the user-agent string and referring to Novellum's documentation.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.