Webmaster.petalsearch
UndecidedCommunity-sourcedPetalBot is the web crawler developed by Huawei's Petal Search engine, designed to index both PC and mobile websites. Its primary function is to gather content from the web to enhance search results and provide content recommendations in services like Huawei Assistant and AI Search. ( aspiegel.com ) You can identify PetalBot by its user-agent string, which varies slightly between PC and mobile versions: PC Version : Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot) Mobile Version : Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) These user-agent strings indicate that the requests are coming from PetalBot. ( aspiegel.com ) PetalBot adheres to the robots.txt protocol, allowing website owners to control its access. By configuring the robots.txt file, you can disallow PetalBot from crawling specific parts of your site. For example, to prevent PetalBot from accessing your entire site, you can add: Alternatively, to allow PetalBot to access only certain directories, you can specify: It's important to note that while PetalBot respects the robots.txt directives, changes may take some time to reflect in the search engine's index. If you notice persistent issues, you can contact Huawei support for assistance. ( aspiegel.com ) For more detailed information about PetalBot, including its user-agent strings and guidelines for managing its access, you can visit Huawei's official page: ( aspiegel.com )
Identification
IP ranges
Requests from Webmaster.petalsearch originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow Webmaster.petalsearch
Add a Disallow rule for Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Webmaster.petalsearch from crawling your entire site User-agent: Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) Disallow: / # Allow Webmaster.petalsearch full access User-agent: Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) Allow: /
Ensure your robots.txt allows Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot). Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction