GhostExplore
GoodBotVerifiedBOTAn aggregator service for websites powered by ghost.org Operated by Ghost Foundation.
What is GhostExplore?
GhostExplore is the official discovery engine for the Ghost publishing platform, designed to maintain the explore.ghost.org directory. It performs lightweight GET and HEAD requests to fetch public metadata, RSS feeds, and ActivityPub information from Ghost-powered sites. By aggregating this data, the bot enables users to search for and discover independent newsletters and publications within the Ghost ecosystem.
Identification
GhostExploreHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- The Major Companies and Media Outlets Blocking OpenAI's Crawler GPTBot - Business Insider
- What Is a robots.txt File? (And When To Use One)
- Known Agents Review: Google Analytics for Bots | Agent Finder
- HUMAN and TollBit Empower Websites with Robust Bot Management and Content Monetization Solutions for AI Agents
Why it crawls your site
The bot crawls to ensure that the Ghost Explore directory remains up-to-date with the latest content, icons, and social activity from public Ghost sites. It operates via queued background jobs rather than aggressive bursts, ensuring minimal impact on server performance. Site operators can verify the bot's identity via its documented user agent and can opt-out of this discovery process directly through their Ghost Admin settings.
Block or allow GhostExplore
Add a Disallow rule for GhostExplore in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block GhostExplore from crawling your entire site User-agent: GhostExplore Disallow: / # Allow GhostExplore full access User-agent: GhostExplore Allow: /
Ensure your robots.txt allows GhostExplore. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction