SH
ShodhyaBot
GoodBotVerifiedBOTCrawler for Shodhya, an Indian web search engine. Obeys robots.txt and noindex; pages are not used for AI training.
Identification
Bot name
ShodhyaBot
Category
Search Engine Crawler
Kind
BOT
Verification
Verified bot
Cloudflare slug
shodhyabot
User-agent patterns
ShodhyaBotTarkaBotUser-agent string
Mozilla/5.0 (compatible; ShodhyaBot/0.1; TarkaBot/0.1; +https://shodhya.com/bot)
Rated Oct 30, 2026 from public evidence
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
Names itself honestly
Yes
Verified by Cloudflare
Yes
Says it follows robots.txt and opt-outs
Yes
Ignores site rules
None found
Disguises itself or evades blocks
None found
Overloads sites
None found
How widely people complain
No complaint about this bot in the evidence
Reddit discussion
There is no Reddit discussion of this bot in the evidence
What we read
- google ignoring robots.txt ? - Google Search Central Community
- How to deal with AI crawlers that ignore robots.txt | Soups Ranjan posted on the topic | LinkedIn
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- 20 Common Robots.txt Issues (and How to Avoid Them)
- AI-bot robots.txt blocker – ClassifAI
Block or allow ShodhyaBot
Block it
Add a Disallow rule for ShodhyaBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block ShodhyaBot from crawling your entire site User-agent: ShodhyaBot Disallow: / # Allow ShodhyaBot full access User-agent: ShodhyaBot Allow: /
Allow & verify
Ensure your robots.txt allows ShodhyaBot. Verify requests by checking the user-agent string.
Traffic & trends
Cloudflare Radar traffic
No Cloudflare traffic data available.
Google Trends interest
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
CloudflareRadar
Last updated October 30, 2026
Something wrong with this entry? Suggest a correction