Scrapy
Bots operated
Every crawler and agent we attribute to Scrapy. Click through for identification, IP ranges, and block rules.
Bot · CategoryCategorySentimentTraffic · 14d
Published IP ranges
Ranges published across Scrapy's crawlers. Match the source IP against this list in addition to the user-agent and reverse-DNS for strict verification.
Showing 24 of 71 ranges
Other operators
Companies operating the most tracked bots.