All categories
CategoryBotsFlagged botsDescription
MO
Monitoring & Analytics
130
0
Uptime, performance, and analytics bots that check that sites are up and measure how they perform.
›
SE
SEO
58
0
Backlink, rank-tracking, and site-audit crawlers run by marketing-tools vendors.
›
SE
Search Engine Crawler
54
0
Discovery-and-indexing crawlers that feed web, image, news, and video search results.
›
AI
AI Assistant
52
0
Agents that browse pages and take actions on behalf of a user in real time, rather than crawling in bulk.
›
WE
Webhooks
51
0
Event-driven callbacks and notification fetchers from apps and platforms.
›
AD
Advertising & Marketing
41
0
Crawlers used for ad verification, brand safety, and contextual targeting.
›
SE
Security
41
0
Scanners that probe the web for vulnerabilities, exposed services, and threats.
›
FE
Feed Fetcher
36
0
Bots that poll RSS/Atom feeds and syndicated content on a schedule.
›
PA
Page Preview
36
0
Link-preview fetchers that render a card when your URL is shared in chat or social apps.
›
AI
AI Crawler
35
0
Bots that gather public web pages to build training data for large language models.
›
OT
Other
29
0
Bots that do not fit the main categories.
›
VE
Verified Bot
24
0
Bots confirmed against an authoritative source such as Cloudflare’s verified-bot list.
›
AG
Aggregator
23
0
Bots that collect and republish content or metadata from across many sites.
›
AI
AI Search
12
0
Crawlers powering AI answer engines that index pages and cite them as sources in generated responses.
›
AC
Accessibility
8
0
Bots that audit pages for accessibility and compliance issues.
›
AR
Archiver
5
0
Bots that capture and preserve snapshots of web pages over time.
›
AC
Academic Research
4
0
Crawlers run by universities and research groups to study the web.
›
SO
Social Media Marketing
3
0
Bots that support social-media scheduling, monitoring, and marketing tools.
›
18 categories · 642 bots tracked