all-infrastructure-ips.json
GoodBotCommunity-sourcedA curated, machine-readable dataset providing up-to-date IP address ranges for known bots, crawlers, and infrastructure services. Operated by sefinek.
What is all-infrastructure-ips.json?
The all-infrastructure-ips.json file is a community-maintained resource hosted on GitHub by user sefinek. It serves as a centralized repository for CIDR-formatted IP lists, enabling developers and system administrators to programmatically verify the origin of incoming web traffic. By providing a reliable source for known bot infrastructure, it assists in distinguishing between beneficial automated agents and potentially malicious actors.
Identification
Why it crawls your site
This bot does not crawl websites in the traditional sense; rather, it acts as a data source for automated systems to perform reverse lookups or IP validation. It is intended to be consumed by firewalls, load balancers, and server-side scripts to ensure that traffic from search engines and verified services is correctly identified. Users can verify the operator by inspecting the public GitHub repository, which maintains transparency regarding the source and update frequency of the IP lists.
IP ranges
Requests from all-infrastructure-ips.json originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow all-infrastructure-ips.json
Add a Disallow rule for all-infrastructure-ips.json in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block all-infrastructure-ips.json from crawling your entire site User-agent: all-infrastructure-ips.json Disallow: / # Allow all-infrastructure-ips.json full access User-agent: all-infrastructure-ips.json Allow: /
Ensure your robots.txt allows all-infrastructure-ips.json. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Related bots
Other crawlers operated by sefinek.
Data sources
This profile is compiled from the following sources.