All categories
CategoryBotsFlagged botsDescription
MO
Monitoring & Analytics
169
0
Uptime, performance, and analytics bots that check that sites are up and measure how they perform.
›
SE
SEO
73
0
Backlink, rank-tracking, and site-audit crawlers run by marketing-tools vendors.
›
SE
Search Engine Crawler
67
0
Discovery-and-indexing crawlers that feed web, image, news, and video search results.
›
AI
AI Assistant
60
0
Agents that browse pages and take actions on behalf of a user in real time, rather than crawling in bulk.
›
WE
Webhooks
57
0
Event-driven callbacks and notification fetchers from apps and platforms.
›
SE
Security
53
0
Scanners that probe the web for vulnerabilities, exposed services, and threats.
›
UN
Uncategorized
50
0
Bots that have not yet been categorised.
›
AD
Advertising & Marketing
45
0
Crawlers used for ad verification, brand safety, and contextual targeting.
›
PA
Page Preview
44
0
Link-preview fetchers that render a card when your URL is shared in chat or social apps.
›
FE
Feed Fetcher
41
0
Bots that poll RSS/Atom feeds and syndicated content on a schedule.
›
AG
Aggregator
38
0
Bots that collect and republish content or metadata from across many sites.
›
AI
AI Crawler
38
0
Bots that gather public web pages to build training data for large language models.
›
VE
Verified Bot
23
0
Bots confirmed against an authoritative source such as Cloudflare’s verified-bot list.
›
AI
AI Search
17
0
Crawlers powering AI answer engines that index pages and cite them as sources in generated responses.
›
OT
Other
12
0
Bots that do not fit the main categories.
›
AC
Accessibility
10
0
Bots that audit pages for accessibility and compliance issues.
›
AC
Academic Research
9
0
Crawlers run by universities and research groups to study the web.
›
AR
Archiver
7
0
Bots that capture and preserve snapshots of web pages over time.
›
SO
Social Media Marketing
4
0
Bots that support social-media scheduling, monitoring, and marketing tools.
›
19 categories · 817 bots tracked