Bingbot/2.0

Bingbot is Microsoft's web crawler responsible for indexing content on the internet to enhance the Bing search engine's results. By systematically browsing websites, Bingbot collects data about page content, links, and site structure, ensuring that Bing's search index remains current and comprehensive. A typical Bingbot user-agent string appears as: This string is present in web server logs, allowing website administrators to identify requests made by Bingbot. In April 2022, Microsoft updated Bingbot's user-agent string to include the specific version of Microsoft Edge used for crawling, enhancing transparency and compatibility. The updated user-agent strings are: Desktop : ``` Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; + http://www.bing.com/bingbot.htm ) Chrome/W.X.Y.Z Safari/537.36 Mobile : ``` Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; + http://www.bing.com/bingbot.htm ) In these strings, "W.X.Y.Z" represents the latest Microsoft Edge version used by Bingbot. This change was fully implemented by January 2023, with the new user-agent now being used for crawling 100% of sites, unless a fallback to the previous user-agent is necessary. ( searchengineland.com ) Website owners can manage Bingbot's access through the robots.txt file by specifying directives to allow or disallow crawling of specific pages or sections. For example, to prevent Bingbot from crawling the entire site, the following directive can be added: This configuration instructs Bingbot to refrain from accessing any pages on the website.