GeedoProductFinder
GoodBotVerifiedBOTA niche crawler identified as a product-focused indexing agent, likely used for price comparison or e-commerce aggregation.
What is GeedoProductFinder?
GeedoProductFinder appears to be a specialized crawler designed to extract product-specific information from e-commerce websites. Unlike general-purpose AI crawlers that scrape data for model training, this agent focuses on identifying product listings, pricing, and availability to populate a niche search or comparison index. Its lack of public documentation suggests it may be a private tool or a smaller, emerging aggregator service.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- google ignoring robots.txt ? - Google Search Central Community
- 🐛 [Bug/Feature]: Not respecting robots.txt · Issue #275 · coleam00/Archon · GitHub
- I wonder if it will actually respect the robots.txt this time. | Hacker News
- AI Crawlers and robots.txt: Which Bots to Allow or Block - eSEOspace
- Why Your robots.txt Won't Protect Your Content From AI
Why it crawls your site
This bot crawls websites to maintain an up-to-date database of product metadata, which is essential for comparison shopping engines or affiliate marketing platforms. By systematically visiting product pages, it ensures that its parent service can provide accurate, real-time information to users looking for specific items. Site owners can verify the operator by checking the IP address against known commercial scraping networks or by looking for a corresponding domain in the bot's request headers.
Block or allow GeedoProductFinder
Add a Disallow rule for GeedoProductFinder in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block GeedoProductFinder from crawling your entire site User-agent: GeedoProductFinder Disallow: / # Allow GeedoProductFinder full access User-agent: GeedoProductFinder Allow: /
Ensure your robots.txt allows GeedoProductFinder. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction