Directory/Categories/Search Engine Crawler/yandexbot

yandexbot

GoodBotVerifiedBOT

The main indexing robot for Yandex search. Operated by Yandex.

Operator website ↗

GoodBot

Assessment

Search Engine Crawler

What is yandexbot?

YandexBot is the core indexing agent for Yandex, the dominant search engine in Russia and a major player in the global search market. It systematically traverses the web to fetch and process content, ensuring that pages are searchable within the Yandex ecosystem. The bot is part of a broader suite of Yandex crawlers that perform specialized tasks, such as accessibility auditing and advertising network verification, and it generally adheres to standard robots.txt directives to respect site owner preferences.

Helpful — It is a legitimate search engine crawler that helps make website content discoverable in Yandex search results.

Identification

Bot name

yandexbot

Operator

Yandex

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly

Yes

Verified by Cloudflare

Yes

Says it follows robots.txt and opt-outs

Not stated

Ignores site rules

Some reports found

Disguises itself or evades blocks

None found

Overloads sites

None found

How widely people complain

One or two isolated anecdotes from individual site owners

Reddit discussion

Discussion is neutral or practical, such as how to allow or block it

What we read

Why it crawls your site

YandexBot crawls the internet to build and maintain the index used by the Yandex search engine to provide relevant results to its users. By downloading and parsing web documents, it enables the search engine to understand site structure, content relevance, and updates. Site owners can verify the authenticity of the bot by performing a reverse DNS lookup on the connecting IP address to ensure it resolves to a domain owned by Yandex, such as yandex.ru or yandex.net.

IP ranges

Requests from yandexbot originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.

Block or allow yandexbot

Block it

Add a Disallow rule for http://yandex.com/bots in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block YandexBot from crawling your entire site
User-agent: http://yandex.com/bots
Disallow: /

# Allow YandexBot full access
User-agent: http://yandex.com/bots
Allow: /