Yahoo! JAPAN
GoodBotVerifiedBOTYahoo! JAPAN manages and operates a system that accesses web pages published on the Internet for the purpose of providing services, research, development, maintenance, etc. Operated by Yahoo! JAPAN (LY Corporation).
What is Yahoo! JAPAN?
Y!J-DLC is the primary crawler agent utilized by Yahoo! JAPAN to discover and index web pages for their search engine ecosystem. Operated by LY Corporation, this bot systematically traverses the internet to ensure that Yahoo! JAPAN's search results remain current, relevant, and comprehensive for their user base. It adheres to standard web crawling protocols and is a critical component of the infrastructure that powers one of Japan's most prominent digital platforms.
Identification
J-DLC/How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- AI Crawl Control robots.txt injection ignores settings across 4 zones (Disallow per - Application Security / Bot Management - Cloudflare Community
- ChatGPT's Fetch Bot Ignores Robots.txt. Now What?
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- Google Just Renamed a Bot That Ignores Your Robots.txt. Your Dealership Site Has Until August. | Savvy Dealer Blog
- Google just added a crawler that ignores robots.txt — Suganthan
Why it crawls your site
The bot crawls the web to populate the Yahoo! JAPAN search index, allowing the company to provide accurate search results and content discovery features to its users. By visiting websites, it gathers metadata and page content, which is then processed to rank pages based on relevance and quality. Site owners can verify the authenticity of this bot by checking that the source IP addresses originate from Yahoo! JAPAN's verified network ranges and by reviewing the official documentation provided on their support portal.
Block or allow Yahoo! JAPAN
Add a Disallow rule for J-DLC/ in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Yahoo! JAPAN from crawling your entire site User-agent: J-DLC/ Disallow: / # Allow Yahoo! JAPAN full access User-agent: J-DLC/ Allow: /
Ensure your robots.txt allows J-DLC/. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction