RDTvlokipBot
GoodBotVerifiedBOTOfficial crawler for RDTvlokip Search, an independent French search engine. Respects robots.txt. Operated by Théo CHARLET.
What is RDTvlokipBot?
RDTvlokipBot is the dedicated web crawler for RDTvlokip Search, a French independent search engine that prioritizes user privacy. Unlike many modern crawlers, it focuses exclusively on static HTML content without executing JavaScript, images, or PDFs, and maintains a strict crawl depth of three levels. Operated by Théo CHARLET, the bot is designed to be lightweight and respectful, featuring adaptive rate limiting and circuit-breaker mechanisms to prevent server strain.
Identification
RDTvlokipBotHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Robots.txt & AI Crawlers in 2026: The Full Guide
- Beyond Robots.txt: Implementing AI.txt and LLMs.txt for Purpose-Based Scraping Control
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- Robots.txt: SEO landmine or secret weapon?
- How to Use robots.txt Disallow to Block Crawlers ...
Why it crawls your site
The bot crawls the web to build and maintain the index for the RDTvlokip search engine. It operates with a 30-day re-crawl cycle and adheres to RFC 9309, ensuring that it respects site owner preferences defined in robots.txt. Site administrators can verify the bot's activity and check their domain's indexing status directly via the official RDTvlokip Search portal, which provides transparency into the bot's behavior and contact channels.
Block or allow RDTvlokipBot
Add a Disallow rule for RDTvlokipBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block RDTvlokipBot from crawling your entire site User-agent: RDTvlokipBot Disallow: / # Allow RDTvlokipBot full access User-agent: RDTvlokipBot Allow: /
Ensure your robots.txt allows RDTvlokipBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction