Screpy
GoodBotVerifiedBOTSEO Checker for Screpy Bot that SEO Operated by Airscarp LLC.
What is Screpy?
ScrepyBot is the proprietary crawler operated by Airscarp LLC for the Screpy SEO platform. It systematically traverses websites to gather technical data, including page status codes, canonical tags, internal link structures, and overall crawlability metrics. The bot is designed to assist webmasters and SEO professionals in identifying technical bottlenecks and quality issues that may impact search engine rankings.
Identification
screpyHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Aggressive BOTS that ignore robots.txt - Ecommerce Templates
- I wonder if it will actually respect the robots.txt this time. - Hacker News
- Configure robots.txt for the Screpy crawler
- Bot or Not: Navigating the New World of AI Content Crawlers
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
Why it crawls your site
ScrepyBot crawls websites to generate comprehensive technical SEO reports and performance audits for users who have registered their domains with the Screpy service. By analyzing page content and headers, it helps users identify broken links, redirect chains, and indexability issues. Site owners can verify the bot's activity by checking their server logs for the 'ScrepyBot' user-agent and ensuring that their robots.txt file is configured to allow or disallow the crawler based on their specific site requirements.
Block or allow Screpy
Add a Disallow rule for screpy in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Screpy from crawling your entire site User-agent: screpy Disallow: / # Allow Screpy full access User-agent: screpy Allow: /
Ensure your robots.txt allows screpy. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction