Directory/Categories/Academic Research/txtbot

txtbot

GoodBotVerifiedBOT

txtbot is a specialized crawler designed to access plain text files (e.g. robots.txt, security.txt, llms.txt, etc.).

Operator website ↗

GoodBot

Assessment

Academic Research

Identification

Bot name

txtbot

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly

Yes

Verified by Cloudflare

Yes

Says it follows robots.txt and opt-outs

Not stated

Ignores site rules

None found

Disguises itself or evades blocks

None found

Overloads sites

None found

How widely people complain

No complaint about this bot in the evidence

Reddit discussion

There is no Reddit discussion of this bot in the evidence

What we read

Block or allow txtbot

Block it

Add a Disallow rule for txtbot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block txtbot from crawling your entire site
User-agent: txtbot
Disallow: /

# Allow txtbot full access
User-agent: txtbot
Allow: /

Allow & verify

Ensure your robots.txt allows txtbot. Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Links & references

Operator documentation

txtbot.net

↗

Cloudflare Radar: txtbot

radar.cloudflare.com/traffic/bots/txtbot

↗

Data sources

This profile is compiled from the following sources.

CloudflareRadar

Last updated October 25, 2026

Something wrong with this entry? Suggest a correction