Webmaster.petalsearch
GoodBotCommunity-sourcedPetalBot is the web crawler developed by Huawei's Petal Search engine, designed to index both PC and mobile websites. Its primary function is to gather content from the web to enhance search results and provide content recommendations in services like Huawei Assistant and AI Search. ( aspiegel.com ) You can identify PetalBot by its user-agent string, which varies slightly between PC and mobile versions: PC Version : Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot) Mobile Version : Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) These user-agent strings indicate that the requests are coming from PetalBot. ( aspiegel.com ) PetalBot adheres to the robots.txt protocol, allowing website owners to control its access. By configuring the robots.txt file, you can disallow PetalBot from crawling specific parts of your site. For example, to prevent PetalBot from accessing your entire site, you can add: Alternatively, to allow PetalBot to access only certain directories, you can specify: It's important to note that while PetalBot respects the robots.txt directives, changes may take some time to reflect in the search engine's index. If you notice persistent issues, you can contact Huawei support for assistance. ( aspiegel.com ) For more detailed information about PetalBot, including its user-agent strings and guidelines for managing its access, you can visit Huawei's official page: ( aspiegel.com ) Operated by Huawei Technologies Co., Ltd..
What is Webmaster.petalsearch?
PetalBot is the proprietary web crawler operated by Huawei for its Petal Search engine. It systematically traverses the web to build a comprehensive index, ensuring that content is discoverable within Huawei's ecosystem, including mobile devices and the Huawei Assistant. By mimicking standard browser behavior, it collects data to provide relevant search results and personalized content recommendations to users globally, particularly in regions where Huawei maintains a significant market presence.
Identification
How we rated this bot
Identifies itself honestly, and we found no credible reports of abuse.
What we read
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- The Major Companies and Media Outlets Blocking OpenAI's Crawler GPTBot - Business Insider
- AGGRESSIVE Definition & Meaning
- Known Agents Review: Google Analytics for Bots | Agent Finder
- HUMAN and TollBit Empower Websites with Robust Bot Management and Content Monetization Solutions for AI Agents
Why it crawls your site
The primary purpose of PetalBot is to populate the Petal Search index, allowing the engine to return accurate and up-to-date results for user queries. It crawls websites to parse HTML content, follow links, and understand site structure, which helps in ranking pages based on relevance. Site owners can verify the bot's authenticity by checking the user-agent string against the official documentation at webmaster.petalsearch.com and can manage its behavior through standard robots.txt directives.
IP ranges
Requests from Webmaster.petalsearch originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow Webmaster.petalsearch
Add a Disallow rule for Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Webmaster.petalsearch from crawling your entire site User-agent: Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) Disallow: / # Allow Webmaster.petalsearch full access User-agent: Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) Allow: /
Ensure your robots.txt allows Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (HTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot). Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction