Cloudflare Custom Error Page Crawler

GoodBotVerifiedSEOBOT

Operated by Cloudflare

What is Cloudflare Custom Error Page Crawler?

Generated from Cloudflare, operator docs, and community data

Cloudflare Custom Error Page Crawler is a web crawler operated by Cloudflare. Cloulflare internal service that crawls customer error pages in order to serve them directly from our edge network.

Helpful — Verified, safe crawler. Respects robots.txt and provides operator documentation.

Details

Bot Name
Cloudflare Custom Error Page Crawler
Slug
cloudflare-collapsify
Kind
BOT
Verification
Verified by Cloudflare
Category
SEO
Operator
Cloudflare

User-Agent Patterns

Collapsify/

Full User-Agent Strings

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10; rv:60.0) Gecko/20100101 Firefox/60.0 Collapsify/0.6.0 node/v10.16.0

Main Use Cases

SEO analysisBacklink discoverySearch ranking monitoring

Why It Crawls Your Site

Cloudflare Custom Error Page Crawler crawls websites to analyze search engine optimization factors and backlinks. It is operated by Cloudflare as part of their SEO analysis infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.

How to Block / Whitelist

Block Cloudflare Custom Error Page Crawler

Add a Disallow rule for Collapsify/ in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block Cloudflare Custom Error Page Crawler from crawling your entire site
User-agent: Collapsify/
Disallow: /

# Allow Cloudflare Custom Error Page Crawler full access
User-agent: Collapsify/
Allow: /

Whitelist Cloudflare Custom Error Page Crawler

Ensure your robots.txt allows Collapsify/. Verify requests are genuine by checking the user-agent string and referring to Cloudflare's documentation.

Related Bots from Cloudflare

Other crawlers operated by Cloudflare

AI SearchCloudflare AI Search is a managed service that lets you connect your data and easily build AI-powered search.AI SearchBushbabyBushbaby is an internal bot used by Cloudflare. Its purpose is to manage and renew SSL certificates for websites that use Cloudflare's services.SecurityCloudflare Browser RunRenders web pages in headless browsers for Cloudflare customers. Used for browser automation (screenshots, PDF generation, content extraction, etc.) and for AI agents to interact with the web. Used by Cloudflare customers via Workers bindings and REST API. Does not include the /crawl endpoint, which has a separate bot identity (Cloudflare Crawler - Signed Agent).AI AssistantCloudflare CSUPCloudflare CSUP is a bot used by Cloudflare's customer support for diagnostic purposes. It is not a general web crawler and is used to investigate technical issues with customer websites. OtherCloudflare CrawlerThe Cloudflare Crawler is a well-behaved crawler that retrieves web content. By default, it self-identifies as a bot, honors robots.txt directives, and cannot bypass CAPTCHAs or bot protection. Used by Cloudflare customers via the Browser Run /crawl endpoint.AI CrawlerCloudflare CustomerSLO ProberA service to verify the identity of Cloudflare-internal Customer SLO probesMonitoring & AnalyticsCloudflare DiagnosticsCloudflare system bot that performs health checks and diagnostic testsMonitoring & AnalyticsCloudflare Digicert DCVCloudflare Digicert DCV service.SEO

Traffic & Trends

Cloudflare Radar Traffic

No Cloudflare traffic data available

Google Trends Interest

Data Sources

This profile was compiled from the following sources:

CloudflareRadar

Last updated: May 26, 2026