RigSoukBot
GoodBotVerifiedBOTA specialized crawler associated with the SysPeek research initiative, primarily focused on data collection for academic analysis. Operated by SysPeek.
What is RigSoukBot?
RigSoukBot is a research-oriented web crawler operated by the SysPeek organization. It is designed to systematically traverse web pages to gather data for academic studies and infrastructure analysis. Unlike commercial AI scrapers, its activity is generally low-volume and targeted toward specific research objectives rather than large-scale model training.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- google ignoring robots.txt ? - Google Search Central Community
- 🐛 [Bug/Feature]: Not respecting robots.txt · Issue #275 · coleam00/Archon · GitHub
- How to deal with AI crawlers that ignore robots.txt | Soups Ranjan posted on the topic | LinkedIn
- Crawler without limits: Perplexity ignores robots.txt | heise online
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
Why it crawls your site
The bot crawls the web to populate datasets for academic research projects hosted under the SysPeek domain. By analyzing site structures and content, the operators aim to derive insights into web accessibility and data distribution patterns. Operators can verify the bot's legitimacy by checking the provided documentation URL, though the current unavailability of the landing page suggests the project may be in a transition phase or restricted to internal network access.
Block or allow RigSoukBot
Add a Disallow rule for RigSoukBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block RigSoukBot from crawling your entire site User-agent: RigSoukBot Disallow: / # Allow RigSoukBot full access User-agent: RigSoukBot Allow: /
Ensure your robots.txt allows RigSoukBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction