shodan
GoodBotCommunity-sourcedA specialized search engine that indexes internet-connected devices, services, and infrastructure to provide visibility into the global threat landscape. Operated by Shodan.
What is shodan?
Shodan operates as a massive, distributed scanning engine that continuously probes the public internet to identify and catalog connected devices, including servers, IoT hardware, and industrial control systems. By capturing banners and metadata from open ports, it creates a searchable database that allows security professionals to track the exposure of specific technologies or services. It is widely considered the industry standard for internet-wide reconnaissance and security posture assessment.
Identification
Why it crawls your site
Shodan crawls the web to map the digital footprint of the internet, helping users understand what devices are exposed and potentially vulnerable. The data collected is used to power their search engine, which allows security researchers to identify misconfigured systems or track the spread of specific software versions. Operators can verify the traffic by checking if the source IP belongs to Shodan's known scanning infrastructure or by reviewing their official documentation on how to opt-out of their indexing.
IP ranges
Requests from shodan originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow shodan
Add a Disallow rule for shodan in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block shodan from crawling your entire site User-agent: shodan Disallow: / # Allow shodan full access User-agent: shodan Allow: /
Ensure your robots.txt allows shodan. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Data sources
This profile is compiled from the following sources.