Bot WHOIS
Submit a botLook up a bot
DirectoryOperatorsCategoriesMethodologyAPIAboutContact
Submit a botLook up a bot

Know exactly what's crawling your site.

An independent, regularly-updated reference for 813 web crawlers, AI bots, and spiders on the internet. See what people are saying about them, get the exact rules for blocking them, and find out who operates them.

Cross-referenced fromCloudflare RadarOperator documentationCrawler databases
813
Bots tracked
566
Operators
722
Verified bots
Ongoing
Enrichment

Browse the directory

Showing 1–50 of 813
Bot · OperatorCategorySentimentTraffic · 14d
2C
2checkout
Verifone
Webhooks
GoodBot
—
›
36
360Monitoring
360Monitoring
Monitoring & Analytics
GoodBot
—
›
AG
AGI Agent
AGI, Inc
AI Assistant
GoodBot
—
›
AI
AI Search
Cloudflare
AI Search
GoodBot
—
›
AI
AI Search External
Unknown operator
AI Search
GoodBot
—
›
AC
AccessStatus
AccessStatus
Monitoring & Analytics
GoodBot
—
›
AC
Accessible Web Bot
Accessible Web
Accessibility
GoodBot
—
›
AC
ActiveComply Bot
ActiveComply
Monitoring & Analytics
GoodBot
—
›
AD
AdIdxBot
Unknown operator
Advertising & Marketing
GoodBot
—
›
AD
AdSensor
AdSensor
Advertising & Marketing
GoodBot
—
›
AD
Adagio Bot
Adagio
Monitoring & Analytics
GoodBot
—
›
AD
AddSearchBot
Addsearch
SEO
GoodBot
—
›
AD
AddThis
AddThis
SEO
GoodBot
—
›
AD
AdsTxtCrawler
OneTag Limited
Advertising & Marketing
GoodBot
—
›
AD
Advailo Kuma
Advailo
Monitoring & Analytics
GoodBot
—
›
AD
AdvallyBot
Advally
Advertising & Marketing
GoodBot
—
›
AD
Adyen
Adyen
Webhooks
GoodBot
—
›
AF
AfterShip Magento 2 Connector
AfterShip
Webhooks
GoodBot
—
›
AG
Agency Analytics Crawler
Agency Analytics
SEO
GoodBot
—
›
AG
AgencyToolsPro Uptime Monitoring Bot
AgencyToolsPro
Monitoring & Analytics
GoodBot
—
›
AH
Ahrefs Site Audit
Ahrefs
SEO
GoodBot
—
›
AH
AhrefsBot
Ahrefs
SEO
GoodBot
—
›
AH
AhrefsBot/7.0
Unknown operator
Uncategorized
Undecided
—
›
AI
AirsoftdbBot
Airsoftdb
Aggregator
GoodBot
—
›
AK
Akismet
Akismet
Webhooks
GoodBot
—
›
AL
Alertsite by Smartbear
Smartbear
Monitoring & Analytics
GoodBot
—
›
AL
Algolia
Algolia
Search Engine Crawler
GoodBot
—
›
AL
AliyunSecBot/Aliyun
Unknown operator
Uncategorized
Undecided
—
›
AL
All Africa Crawler
AllAfrica Global Media
Search Engine Crawler
GoodBot
—
›
AL
Alli AI Bot
Alli AI
SEO
GoodBot
—
›
AL
Alphalens Bot
Alphalens
AI Search
GoodBot
—
›
AM
Amazon AdBot
Amazon
Advertising & Marketing
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (AP Northeast)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (AP South)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (AP Southeast 1)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (AP Southeast)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (EU Central 1)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (EU West 1)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (US East 1)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (US East 2)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Bedrock AgentCore Browser (US West 2)
Amazon
AI Assistant
GoodBot
—
›
AM
Amazon Buy For Me
Amazon
Other
GoodBot
—
›
AM
Amazon Contxbot
Amazon
Advertising & Marketing
GoodBot
—
›
AM
Amazon Kendra
Amazon
AI Crawler
GoodBot
—
›
AM
Amazonbot
Amazon
AI Crawler
GoodBot
−17%
›
AM
Amazonbot/0.1
Unknown operator
Uncategorized
Undecided
—
›
AM
Amzn-SearchBot
Unknown operator
AI Search
GoodBot
—
›
AN
Anchor Browser
Anchor
AI Crawler
GoodBot
—
›
AP
Apify Website Content Crawler
Apify
AI Assistant
GoodBot
—
›
AP
AppcastBot
Appcast
Feed Fetcher
GoodBot
—
›
Showing 1–50 of 813
Per page