PetalBot
UndecidedVerifiedBOTPetalBot is the web crawler developed by Huawei's Petal Search engine, designed to index both PC and mobile websites. Its primary function is to gather content from the web to enhance search results and provide content recommendations in services like Huawei Assistant and AI Search. ( aspiegel.com ) You can identify PetalBot by its user-agent string, which varies slightly between PC and mobile versions: PC Version : Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot) Mobile Version : Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) These user-agent strings indicate that the requests are coming from PetalBot. ( aspiegel.com ) PetalBot adheres to the robots.txt protocol, allowing website owners to control its access. By configuring the robots.txt file, you can disallow PetalBot from crawling specific parts of your site. For example, to prevent PetalBot from accessing your entire site, you can add: Alternatively, to allow PetalBot to access only certain directories, you can specify: It's important to note that while PetalBot respects the robots.txt directives, changes may take some time to reflect in the search engine's index. If you notice persistent issues, you can contact Huawei support for assistance. ( aspiegel.com ) For more detailed information about PetalBot, including its user-agent strings and guidelines for managing its access, you can visit Huawei's official page: ( aspiegel.com ) Operated by Huawei.
What is PetalBot?
PetalBot is a web crawler operated by Huawei. PetalBot is to access both PC and mobile websites and establish an index database which enables users to search the content of your site in Petal search engine and present content recommendations for the user in Huawei Assistant and AI Search services, both services are powered by Petal Search engine. It is part of the growing wave of AI-powered crawlers that collect web data for training and improving AI models.
Identification
PetalBotWhy it crawls your site
PetalBot crawls websites to collect and process web content for AI model training and improvement. It is operated by Huawei as part of their AI and machine learning infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.
IP ranges
Requests from PetalBot originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow PetalBot
Add a Disallow rule for PetalBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block PetalBot from crawling your entire site User-agent: PetalBot Disallow: / # Allow PetalBot full access User-agent: PetalBot Allow: /
Ensure your robots.txt allows PetalBot. Verify requests are genuine by checking the user-agent string and referring to Huawei's documentation.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction