creobot
GoodBotVerifiedBOTThis bot download assets from the origin server. Operated by creoline GmbH.
What is creobot?
Creobot is the automated agent associated with the creoline GmbH Content Delivery Network (CDN). It functions as a utility crawler that retrieves page content to facilitate the generation of link previews and to ensure the proper functioning of CDN-related features. By accessing public-facing web resources, it allows the creoline platform to display accurate information when content is shared or managed through their infrastructure.
Identification
CreobotHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- Google Just Renamed a Bot That Ignores Your Robots.txt. Your Dealership Site Has Until August. | Savvy Dealer Blog
- ChatGPT's Fetch Bot Ignores Robots.txt. Now What?
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
Why it crawls your site
Creobot crawls websites to perform metadata extraction and resource verification necessary for the creoline CDN's preview services. It ensures that when a user interacts with a site hosted or accelerated by creoline, the system has the most current information to render previews correctly. Operators can verify this bot by checking for requests originating from creoline's infrastructure, which is documented in their official help resources regarding their CDN technology stack.
Block or allow creobot
Add a Disallow rule for Creobot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block creobot from crawling your entire site User-agent: Creobot Disallow: / # Allow creobot full access User-agent: Creobot Allow: /
Ensure your robots.txt allows Creobot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction