Cloudflare Custom Error Page Crawler
GoodBotVerifiedBOTCloulflare internal service that crawls customer error pages in order to serve them directly from our edge network. Operated by Cloudflare.
What is Cloudflare Custom Error Page Crawler?
Cloudflare Custom Error Page Crawler is a web crawler operated by Cloudflare. Cloulflare internal service that crawls customer error pages in order to serve them directly from our edge network.
Identification
Collapsify/Why it crawls your site
Cloudflare Custom Error Page Crawler crawls websites to analyze search engine optimization factors and backlinks. It is operated by Cloudflare as part of their SEO analysis infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.
Block or allow Cloudflare Custom Error Page Crawler
Add a Disallow rule for Collapsify/ in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Cloudflare Custom Error Page Crawler from crawling your entire site User-agent: Collapsify/ Disallow: / # Allow Cloudflare Custom Error Page Crawler full access User-agent: Collapsify/ Allow: /
Ensure your robots.txt allows Collapsify/. Verify requests are genuine by checking the user-agent string and referring to Cloudflare's documentation.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Related bots
Other crawlers operated by Cloudflare.
Data sources
This profile is compiled from the following sources.