Bot directory · Search engines
Search engines · Huawei
PetalBot
Huawei’s crawler for Petal Search, the default search on Huawei phones outside China.
- Operator
- Huawei
- Purpose
- Search index. The crawlers behind Google, Bing and the other search engines. Blocking one drops you out of its results.
- robots.txt token
PetalBot- User agent
Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot)- Documentation
- webmaster.petalsearch.com/site/petalbot
Block PetalBot
Add a group naming it to /robots.txt. Compliant crawlers stop before requesting any page. A firewall rule on the user agent is the only way to enforce it against crawlers that ignore robots.txt.
User-agent: PetalBot
Disallow: /
Allow PetalBot when everything else is blocked
A group naming the bot wins over User-agent: *, so an explicit allow lets it in while your catch-all rules stay in place.
User-agent: PetalBot
Allow: /
User-agent: *
Disallow: /
Does PetalBot reach your site?
The checker applies your robots.txt the way PetalBot does, then requests your page with the user agent above, alongside 29 other bots, and opens the report on PetalBot.
Other search engines: Googlebot, Bingbot, DuckDuckBot, Applebot, YandexBot, Baiduspider.
Build a complete file with the robots.txt generator.