Skip to content
TN

TNOThesisCrawler

GoodBotVerifiedBOT

Research crawler by TNO collecting publicly available academic theses from university websites for the DIAMONDS platform

GoodBot
Assessment
Academic Research
Category
BOT
Kind
1
Data sources

Identification

Bot name
TNOThesisCrawler
Category
Academic Research
Kind
BOT
Verification
Verified bot
Cloudflare slug
tnothesiscrawler-3
User-agent patterns
TNOThesisCrawler
User-agent string
TNOThesisCrawler/1.0 (+https://diamonds.tno.nl/bot-policy; email: [email protected])

Block or allow TNOThesisCrawler

Block it

Add a Disallow rule for TNOThesisCrawler in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block TNOThesisCrawler from crawling your entire site
User-agent: TNOThesisCrawler
Disallow: /

# Allow TNOThesisCrawler full access
User-agent: TNOThesisCrawler
Allow: /
Allow & verify

Ensure your robots.txt allows TNOThesisCrawler. Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Data sources

This profile is compiled from the following sources.

CloudflareRadar
Last updated September 8, 2026

Something wrong with this entry? Suggest a correction