DuckDuckBot/1.1
UndecidedCommunity-sourcedDuckDuckBot/1.1 is the web crawler used by DuckDuckGo to enhance its search results and provide users with the best and most secure search experience possible. Its user agent string is DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) . This crawler adheres to the robots.txt protocol, ensuring it respects website owners' preferences regarding automated access. DuckDuckBot/1.1 operates from a range of IP addresses, including: 57.152.72.128 51.8.253.152 40.80.242.63 20.12.141.99 20.49.136.28 51.116.131.221 51.107.40.209 20.40.133.240 20.50.168.91 51.120.48.122 20.193.45.113 40.76.173.151 40.76.163.7 20.185.79.47 52.142.26.175 20.185.79.15 52.142.24.149 40.76.162.208 40.76.163.23 40.76.162.191 40.76.162.247 40.88.21.235 20.191.45.212 52.146.59.12 52.146.59.156 52.146.59.154 52.146.58.236 20.62.224.44 51.104.180.53 51.104.180.47 51.104.180.26 51.104.146.225 51.104.146.235 20.73.202.147 20.73.132.240 20.71.12.143 For more detailed information about DuckDuckBot, you can visit DuckDuckGo's official page:
Identification
IP ranges
Requests from DuckDuckBot/1.1 originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow DuckDuckBot/1.1
Add a Disallow rule for DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block DuckDuckBot/1.1 from crawling your entire site User-agent: DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) Disallow: / # Allow DuckDuckBot/1.1 full access User-agent: DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) Allow: /
Ensure your robots.txt allows DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html). Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction