Bot WHOIS
Submit a botLook up a bot
Directory/Categories/Academic Research/TNOThesisCrawler
TNO (Netherlands Organization for Applied Scientific Research) logo

TNOThesisCrawler

GoodBotVerifiedBOT

Research crawler by TNO collecting publicly available academic theses from university websites for the DIAMONDS platform Operated by TNO (Netherlands Organization for Applied Scientific Research).

GoodBot
Assessment
Academic Research
Category
BOT
Kind
1
Data sources
AI-generated summary, drawn from Cloudflare, operator docs, and community data

What is TNOThesisCrawler?

TNOThesisCrawler is a specialized web crawler developed by the Netherlands Organization for Applied Scientific Research (TNO) as part of their Diamonds platform. Its primary function is to systematically discover and collect publicly accessible academic master's theses and related scholarly documents from university websites. The bot is designed with transparency in mind, providing clear contact information and adhering to standard web etiquette, including respect for robots.txt directives and a conservative request rate.

Helpful — The bot is transparently operated by a reputable research institute, respects robots.txt, and limits its crawl rate to prevent server strain.

Identification

Bot name
TNOThesisCrawler
Operator
TNO (Netherlands Organization for Applied Scientific Research)
Category
Academic Research
Kind
BOT
Verification
Verified bot
Cloudflare slug
tnothesiscrawler-3
User-agent patterns
TNOThesisCrawler
User-agent string
TNOThesisCrawler/1.0 (+https://diamonds.tno.nl/bot-policy; email: [email protected])
Main use cases
Academic data collectionResearch repository indexing
Rated Sep 23, 2026 from public evidence

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly
Yes
Verified by Cloudflare
Yes
Says it follows robots.txt and opt-outs
Not stated
Ignores site rules
None found
Disguises itself or evades blocks
None found
Overloads sites
None found
How widely people complain
No complaint about this bot in the evidence
Reddit discussion
There is no Reddit discussion of this bot in the evidence

What we read

Why it crawls your site

The bot crawls the web to build a comprehensive, centralized index of academic output for the Diamonds research platform. By aggregating these documents, TNO aims to facilitate large-scale analysis of academic trends and research dissemination. The operator ensures legitimacy by providing a dedicated policy page and a support email address, allowing site administrators to verify the bot's identity and request adjustments to its crawling behavior if necessary.

Block or allow TNOThesisCrawler

Block it

Add a Disallow rule for TNOThesisCrawler in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block TNOThesisCrawler from crawling your entire site
User-agent: TNOThesisCrawler
Disallow: /

# Allow TNOThesisCrawler full access
User-agent: TNOThesisCrawler
Allow: /
Allow & verify

Ensure your robots.txt allows TNOThesisCrawler. Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Links & references

TNO (Netherlands Organization for Applied Scientific Research) documentation
diamonds.tno.nl/bot-policy
↗
Cloudflare Radar: TNOThesisCrawler
radar.cloudflare.com/traffic/bots/tnothesiscrawler-3
↗

Data sources

This profile is compiled from the following sources.

CloudflareRadar
Last updated October 25, 2026

Something wrong with this entry? Suggest a correction