MJ12bot/v2.0.4
UndecidedCommunity-sourcedMJ12bot, specifically version 2.0.4, is a web crawler developed by Majestic-12, a company that specializes in building and maintaining a comprehensive index of the web. The MJ12bot operates by systematically browsing the internet to gather data on websites, which is then used to enhance search engine optimization (SEO) tools and services. This bot is designed to comply with the robots.txt standard, which allows webmasters to manage how bots interact with their sites. Moreover, MJ12bot focuses on collecting information that can improve backlink analysis, keyword tracking, and other features beneficial for digital marketers and website administrators. The bot's crawling capabilities include assessing page content, structure, and various inbound and outbound links, ultimately creating a detailed map of site interconnectivity across the web. The insights from MJ12bot can help users to understand their website's performance in relation to competitors and optimize their online presence effectively. For more details on MJ12bot, you can visit the official website at http://mj12bot.com/ .
Identification
IP ranges
Requests from MJ12bot/v2.0.4 originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow MJ12bot/v2.0.4
Add a Disallow rule for Mozilla/5.0 (compatible; MJ12bot/v2.0.4; http://mj12bot.com/) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block MJ12bot/v2.0.4 from crawling your entire site User-agent: Mozilla/5.0 (compatible; MJ12bot/v2.0.4; http://mj12bot.com/) Disallow: / # Allow MJ12bot/v2.0.4 full access User-agent: Mozilla/5.0 (compatible; MJ12bot/v2.0.4; http://mj12bot.com/) Allow: /
Ensure your robots.txt allows Mozilla/5.0 (compatible; MJ12bot/v2.0.4; http://mj12bot.com/). Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction