YahooMailProxy (WBA)
GoodBotVerifiedBOTForward Proxy used by Yahoo Mail to fetch assets embedded in the bodies of user emails. Operated by Yahoo.
What is YahooMailProxy (WBA)?
YahooMailProxy is an automated service operated by Yahoo that acts as an intermediary between Yahoo Mail users and external web content. It is primarily responsible for fetching metadata and page content to generate rich link previews within the email interface, ensuring users can see a summary of a link before clicking. Additionally, the proxy plays a role in security by inspecting linked content to protect users from potentially harmful or malicious websites.
Identification
YahooMailProxyHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- What do you mean by "barely" respecting robots.txt? Wouldn't that ...
- AI Companies Ignoring Robots.txt - Michael Tsai
- How to handle AI crawlers that ignore robots.txt - LinkedIn
- Bots slamming my site - Crawler, Spider, and User Agent ID forum at ...
- Control bots, spiders, and crawlers - DreamHost Knowledge Base
Why it crawls your site
The bot crawls websites to retrieve the necessary HTML metadata, such as Open Graph tags or page titles, required to populate link previews in the Yahoo Mail client. By performing these requests server-side, Yahoo ensures that the user's IP address is not exposed to the destination site and that the content is pre-screened for security threats. Site owners can verify the bot's legitimacy by checking the provided documentation link in the User-Agent string, which confirms its association with Yahoo's infrastructure.
Block or allow YahooMailProxy (WBA)
Add a Disallow rule for YahooMailProxy in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block YahooMailProxy (WBA) from crawling your entire site User-agent: YahooMailProxy Disallow: / # Allow YahooMailProxy (WBA) full access User-agent: YahooMailProxy Allow: /
Ensure your robots.txt allows YahooMailProxy. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Related bots
Other crawlers operated by Yahoo.
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction