DirectoriesBot
GoodBotVerifiedBOTProsvita Directories fetches one page, reads the links on it, and records whether one of them points at the listing. Operated by Driven Success LLC.
What is DirectoriesBot?
DirectoriesBot is a targeted crawler operated by Driven Success LLC designed to verify that websites maintain required reciprocal links for business directory listings. Unlike general-purpose crawlers, it does not index content, train AI models, or store page data; it simply fetches a specific URL to confirm the existence of a link. The bot is highly transparent, providing cryptographic signatures for verification and clear documentation on its limited scope and behavior.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- google ignoring robots.txt ? - Google Search Central Community
- I wonder if it will actually respect the robots.txt this time. | Hacker News
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- 20 Common Robots.txt Issues (and How to Avoid Them)
- AI-bot robots.txt blocker – ClassifAI
Why it crawls your site
The bot crawls to ensure that businesses participating in link directories fulfill their agreement to link back to the directory. By fetching only the specific page where a listing is expected, it minimizes server load and avoids unnecessary data collection. Operators can verify the bot's identity through RFC 9421-compliant HTTP message signatures, ensuring that the requests are legitimate and originate from the official service.
Block or allow DirectoriesBot
Add a Disallow rule for DirectoriesBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block DirectoriesBot from crawling your entire site User-agent: DirectoriesBot Disallow: / # Allow DirectoriesBot full access User-agent: DirectoriesBot Allow: /
Ensure your robots.txt allows DirectoriesBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction