MJ12bot/v1.4.8
UndecidedCommunity-sourcedMJ12bot/v1.4.8 is a web crawler developed by Majestic-12 Ltd, a UK-based company specializing in search engine technologies. This bot is designed to map the link relationships between websites, contributing to the creation of a comprehensive search engine. It operates by crawling the web and collecting data on website interconnections, which is then used to build a public backlinks index accessible through Majestic's Site Explorer. The MJ12bot/v1.4.8 user agent string is: Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) This indicates that the bot identifies itself as MJ12bot version 1.4.8 and provides a link to its official website for more information. ( user-agents.net ) MJ12bot adheres to the robots.txt standard, allowing website owners to control its access to their sites. To block MJ12bot from crawling a website, the following directive can be added to the site's robots.txt file: This instructs MJ12bot to refrain from accessing any pages on the site. For more detailed information about MJ12bot and its functionalities, you can visit its official website at mj12bot.com .
Identification
IP ranges
Requests from MJ12bot/v1.4.8 originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow MJ12bot/v1.4.8
Add a Disallow rule for Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block MJ12bot/v1.4.8 from crawling your entire site User-agent: Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) Disallow: / # Allow MJ12bot/v1.4.8 full access User-agent: Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) Allow: /
Ensure your robots.txt allows Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/). Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction