Nekuda WebMCP Discovery Bot
GoodBotVerifiedBOTA discovery crawler associated with the Nekuda ecosystem, specifically designed to index and verify websites that support the WebMCP (Web Model Context Protocol) standard. Operated by Nekuda.
What is Nekuda WebMCP Discovery Bot?
The Nekuda WebMCP Discovery Bot is an automated agent operated by Nekuda to map the emerging landscape of WebMCP-enabled websites. It functions as a specialized indexer that identifies and verifies sites that have implemented the Web Model Context Protocol, which allows AI assistants to interact directly with web content. By cataloging these sites, the bot supports the functionality of the 'Ask Nekuda' Chrome extension and the broader webmcp.cool directory, ensuring that users can find and utilize AI-ready web experiences.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- WebMCP: Every Website Is Getting an Agent (Plus A Live Demo!) — nekuda
- Block the Bots that Feed “AI” Models by Scraping Your Website – Neil Clarke
- How to deal with AI crawlers that ignore robots.txt | Soups Ranjan posted on the topic | LinkedIn
- robots.txt for AI Crawlers: GPTBot, ClaudeBot and More
- OpenAI, Anthropic Ignore Rule That Prevents Bots Scraping Web Content - Business Insider
Why it crawls your site
This bot crawls the web to populate a registry of websites that support the WebMCP standard, which enables structured communication between web servers and AI agents. It specifically looks for the presence of WebMCP endpoints or metadata to ensure that the 'Ask Nekuda' assistant can provide accurate, context-aware interactions. Website owners can verify the bot's activity by checking for requests originating from Nekuda-associated infrastructure, which is intended to improve the discoverability of their AI-integrated content.
Block or allow Nekuda WebMCP Discovery Bot
Add a Disallow rule for Nekuda WebMCP Discovery Bot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Nekuda WebMCP Discovery Bot from crawling your entire site User-agent: Nekuda WebMCP Discovery Bot Disallow: / # Allow Nekuda WebMCP Discovery Bot full access User-agent: Nekuda WebMCP Discovery Bot Allow: /
Ensure your robots.txt allows Nekuda WebMCP Discovery Bot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction