all-safe-ips.json

The all-safe-ips.json file is a component of the sefinek/trusted-ips-whitelist project, which serves as a community-maintained repository of IP addresses belonging to known, verified web crawlers. It acts as a reference point for developers and system administrators who need to ensure that legitimate traffic from search engines, AI agents, and monitoring services is not inadvertently blocked by security rules. By providing structured JSON data, it simplifies the process of updating firewall and WAF rules to maintain site accessibility for essential automated services.

This bot does not crawl in the traditional sense of indexing content; rather, it functions as a data distribution mechanism for network security configurations. It exists to help maintain the integrity of web traffic by distinguishing between beneficial automated agents and malicious actors. Operators can verify the legitimacy of this data by auditing the source repository on GitHub, which tracks changes to IP ranges for major crawlers like Googlebot, Bingbot, and various AI scrapers.