OnticaBot
GoodBotVerifiedBOTFeed-fetching crawler that discovers and fetches public articles for curated content feeds Operated by Ontica.
What is OnticaBot?
OnticaBot is a specialized crawler operated by Ontica, designed to scan the web for high-quality articles to populate curated content feeds. Unlike aggressive scrapers, it operates with a focus on transparency, adhering to standard web protocols like robots.txt and maintaining conservative crawl rates to avoid impacting server performance. The bot is primarily used to power content discovery engines, ensuring that users receive relevant and timely information through Ontica's aggregation services.
Identification
OnticaBotHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
Why it crawls your site
The bot crawls the web to identify and index publicly accessible articles that meet specific quality criteria for inclusion in Ontica's curated feeds. By fetching this content, the system can generate summaries and organize information for its users, effectively acting as a discovery layer for web content. Site owners can verify the bot's activity via its unique User-Agent string and can manage its access or request removal by contacting the support email provided on the official OnticaBot documentation page.
Block or allow OnticaBot
Add a Disallow rule for OnticaBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block OnticaBot from crawling your entire site User-agent: OnticaBot Disallow: / # Allow OnticaBot full access User-agent: OnticaBot Allow: /
Ensure your robots.txt allows OnticaBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction