Bot WHOIS
Submit a botLook up a bot
Directory/Categories/Academic Research/CLB Insight
CL

CLB Insight

GoodBotVerifiedBOT

We perform research on marketing websites for financial institutions to identify tech, ADA, AI, and content trends. Operated by COLAB.

GoodBot
Assessment
Academic Research
Category
BOT
Kind
1
Data sources
AI-generated summary, drawn from Cloudflare, operator docs, and community data

What is CLB Insight?

CLB Insight is a specialized research crawler developed by COLAB to gather data on how organizations structure their online presence. Unlike commercial scrapers, it focuses on technical metadata, accessibility metrics, and performance indicators rather than content harvesting. The bot is designed with transparency in mind, offering site owners the ability to verify its identity through IETF HTTP Message Signatures and providing clear opt-out mechanisms via standard robots.txt directives.

Helpful — The bot is transparent, respects robots.txt, provides clear contact information, and supports cryptographic verification to ensure authenticity.

Identification

Bot name
CLB Insight
Operator
COLAB
Category
Academic Research
Kind
BOT
Verification
Verified bot
Cloudflare slug
clb-insight
Main use cases
Web technology stack analysisAccessibility and performance benchmarkingOrganizational digital presence research
Rated Oct 20, 2026 from public evidence

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly
Yes
Verified by Cloudflare
Yes
Says it follows robots.txt and opt-outs
Not stated
Ignores site rules
None found
Disguises itself or evades blocks
None found
Overloads sites
None found
How widely people complain
No complaint about this bot in the evidence
Reddit discussion
There is no Reddit discussion of this bot in the evidence

What we read

Why it crawls your site

The bot crawls the web to build a longitudinal dataset regarding the evolution of web technologies and organizational digital standards. By analyzing public-facing pages, it generates insights into industry-wide trends in web development and accessibility compliance. Operators can verify the bot's legitimacy by checking the public Ed25519 key hosted at the /.well-known/http-message-signatures-directory endpoint on the CLB Insight domain.

Block or allow CLB Insight

Block it

Add a Disallow rule for CLB Insight in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block CLB Insight from crawling your entire site
User-agent: CLB Insight
Disallow: /

# Allow CLB Insight full access
User-agent: CLB Insight
Allow: /
Allow & verify

Ensure your robots.txt allows CLB Insight. Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Links & references

COLAB documentation
app.clbinsight.com/bot
↗
Cloudflare Radar: CLB Insight
radar.cloudflare.com/traffic/bots/clb-insight
↗

Data sources

This profile is compiled from the following sources.

CloudflareRadar
Last updated October 25, 2026

Something wrong with this entry? Suggest a correction