YandexBot
GoodBotVerifiedBOTThe primary web crawler for the Yandex search engine, responsible for discovering and indexing content for Yandex Search. Operated by Yandex.
What is YandexBot?
YandexBot is the core indexing agent for Yandex, the dominant search engine in Russia and a major player in the global search market. It systematically traverses the web to fetch and process content, ensuring that pages are searchable within the Yandex ecosystem. The bot is part of a broader suite of Yandex crawlers that perform specialized tasks, such as accessibility auditing and advertising network verification, and it generally adheres to standard robots.txt directives to respect site owner preferences.
Identification
http://yandex.com/botsWhy it crawls your site
YandexBot crawls the internet to build and maintain the index used by the Yandex search engine to provide relevant results to its users. By downloading and parsing web documents, it enables the search engine to understand site structure, content relevance, and updates. Site owners can verify the authenticity of the bot by performing a reverse DNS lookup on the connecting IP address to ensure it resolves to a domain owned by Yandex, such as yandex.ru or yandex.net.
Block or allow YandexBot
Add a Disallow rule for http://yandex.com/bots in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block YandexBot from crawling your entire site User-agent: http://yandex.com/bots Disallow: / # Allow YandexBot full access User-agent: http://yandex.com/bots Allow: /
Ensure your robots.txt allows http://yandex.com/bots. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Links & references
Data sources
This profile is compiled from the following sources.