baidu
GoodBotCommunity-sourcedThe primary web crawler for Baidu, the dominant search engine in China, responsible for indexing content to appear in Baidu search results. Operated by Baidu.
What is baidu?
Baiduspider is the official web crawler operated by Baidu, the leading search engine provider in China. It systematically traverses the web to index pages, images, and multimedia content, ensuring that websites are discoverable through Baidu's search interface. While Baidu also operates specialized crawlers like ERNIEBot for AI training and YiyanBot for its conversational assistant, Baiduspider remains the core engine for traditional search indexing.
Identification
Why it crawls your site
The primary purpose of Baiduspider is to maintain an up-to-date index of the internet to provide relevant search results to Baidu users. By crawling and parsing HTML, it extracts metadata and content to determine page relevance and ranking. Website owners can verify the authenticity of this bot by performing a reverse DNS lookup on the requesting IP address to ensure it originates from the baidu.com domain, as documented in Baidu's official webmaster guidelines.
IP ranges
Requests from baidu originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow baidu
Add a Disallow rule for baidu in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block baidu from crawling your entire site User-agent: baidu Disallow: / # Allow baidu full access User-agent: baidu Allow: /
Ensure your robots.txt allows baidu. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Related bots
Other crawlers operated by Baidu.
Data sources
This profile is compiled from the following sources.