KeenableBot
GoodBotBotwhois.orgKeenableBot is a web crawler operated by Keenable.ai that indexes public web content to power search results for AI agents and applications. Operated by Keenable.ai, Inc..
What is KeenableBot?
KeenableBot is the primary crawler for Keenable.ai, a platform focused on providing search and content access APIs specifically for AI agents. Unlike general-purpose search engines, KeenableBot is designed to feed a specialized index that allows AI systems to retrieve and cite public web information. The operator, Keenable.ai, Inc., emphasizes transparency by providing clear instructions for site owners to control crawl behavior via standard robots.txt directives and meta tags.
Identification
How we rated this bot
Identifies itself honestly, and we found no credible reports of abuse.
What we read
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- Googlebot ignores robots.txt - Google Search Central Community
- 9 Robots.txt Rules Googlebot Ignores Even If You Add Them to ...
- Does llms.txt Help SEO? Google Says It Ignores the File
- The Major Companies and Media Outlets Blocking OpenAI's Crawler GPTBot - Business Insider
Why it crawls your site
KeenableBot crawls the web to populate a proprietary search index that enables AI agents to perform real-time, cited research. By indexing public pages, the bot ensures that AI models have access to current, verifiable information rather than relying solely on static training data. Site owners can verify the bot's identity through its published documentation and are encouraged to use standard robots.txt rules to manage its access or request removal of content via the provided abuse contact.
Block or allow KeenableBot
Add a Disallow rule for Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/bot) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block KeenableBot from crawling your entire site User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/bot) Disallow: / # Allow KeenableBot full access User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/bot) Allow: /
Ensure your robots.txt allows Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/bot). Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction