Bot WHOIS
Submit a botLook up a bot
Directory/Categories/Academic Research/HemerolabBot
HE

HemerolabBot

GoodBotVerifiedBOT

A research-oriented web crawler that maintains a private, versioned archive of public web pages and feeds for forecasting and data analysis. Operated by Hemerolab.

GoodBot
Assessment
Academic Research
Category
BOT
Kind
1
Data sources
AI-generated summary, drawn from Cloudflare, operator docs, and community data

What is HemerolabBot?

HemerolabBot is the proprietary crawler for Hemerolab, a research project focused on tracking public web data for forecasting purposes. Unlike many modern crawlers, it explicitly disclaims the use of collected data for AI model training, data sales, or public republication. The bot is designed to be transparent, utilizing cryptographic signatures via the Web Bot Auth standard to allow site owners to verify the authenticity of its requests.

Helpful — The operator provides clear documentation, respects robots.txt, and explicitly states that data is not used for AI training or commercial resale.

Identification

Bot name
HemerolabBot
Operator
Hemerolab
Category
Academic Research
Kind
BOT
Verification
Verified bot
Cloudflare slug
hemerolabbot
Main use cases
Academic research and forecastingPublic data archivingMonitoring web content changes
Rated Oct 21, 2026 from public evidence

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly
Yes
Verified by Cloudflare
Yes
Says it follows robots.txt and opt-outs
Yes
Ignores site rules
None found
Disguises itself or evades blocks
None found
Overloads sites
None found
How widely people complain
No complaint about this bot in the evidence
Reddit discussion
There is no Reddit discussion of this bot in the evidence

What we read

Why it crawls your site

The bot crawls the web to build a private, versioned historical archive of public information, such as news, economic indicators, and sports results. By recording when specific versions of pages were first seen, Hemerolab aims to support longitudinal research and predictive modeling. Site owners can verify the bot's identity by checking the public keys published at the operator's well-known directory, ensuring that the traffic is indeed coming from the legitimate research project.

Block or allow HemerolabBot

Block it

Add a Disallow rule for HemerolabBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block HemerolabBot from crawling your entire site
User-agent: HemerolabBot
Disallow: /

# Allow HemerolabBot full access
User-agent: HemerolabBot
Allow: /
Allow & verify

Ensure your robots.txt allows HemerolabBot. Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Links & references

Hemerolab documentation
hemerolab.com/bot
↗
Cloudflare Radar: HemerolabBot
radar.cloudflare.com/traffic/bots/hemerolabbot
↗

Data sources

This profile is compiled from the following sources.

CloudflareRadar
Last updated October 25, 2026

Something wrong with this entry? Suggest a correction