TH
TheSpreadBot
GoodBotVerifiedBOTFetches BC news RSS feeds. Keeps headlines, links, snippets; descriptions 30 days. AI summaries, no training. See /bot.
Identification
Bot name
TheSpreadBot
Category
Feed Fetcher
Kind
BOT
Verification
Verified bot
Cloudflare slug
thespreadbot
Block or allow TheSpreadBot
Block it
Add a Disallow rule for TheSpreadBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block TheSpreadBot from crawling your entire site User-agent: TheSpreadBot Disallow: / # Allow TheSpreadBot full access User-agent: TheSpreadBot Allow: /
Allow & verify
Ensure your robots.txt allows TheSpreadBot. Verify requests by checking the user-agent string.
Traffic & trends
Cloudflare Radar traffic
No Cloudflare traffic data available.
Google Trends interest
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
CloudflareRadar
Last updated October 30, 2026
Something wrong with this entry? Suggest a correction