AhrefsBot/7.0
GoodBotCommunity-sourcedAhrefsBot is a web crawler that indexes the internet to power Ahrefs' SEO toolset and the Yep search engine. Operated by Ahrefs.
What is AhrefsBot/7.0?
AhrefsBot is the primary web crawler operated by Ahrefs, a prominent provider of marketing intelligence and SEO software. It systematically traverses the web to build a massive, proprietary index of backlinks, keywords, and site performance metrics. Beyond supporting Ahrefs' suite of analytical tools, the data collected by this bot also powers Yep, an independent search engine focused on privacy and content creator compensation.
Identification
Why it crawls your site
The bot crawls the web to maintain an up-to-date database that allows users to monitor their site's health, analyze competitor strategies, and track search engine rankings. By indexing pages, Ahrefs provides actionable insights that help website owners improve their visibility and SEO performance. The operator maintains transparency by providing clear documentation, IP verification lists, and full support for robots.txt directives, ensuring that site owners can control or limit the bot's access to their infrastructure.
IP ranges
Requests from AhrefsBot/7.0 originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow AhrefsBot/7.0
Add a Disallow rule for Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block AhrefsBot/7.0 from crawling your entire site User-agent: Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) Disallow: / # Allow AhrefsBot/7.0 full access User-agent: Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) Allow: /
Ensure your robots.txt allows Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/). Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction