Bot WHOIS
Submit a botLook up a bot
Directory/Categories/Academic Research/BidsterBot
BI

BidsterBot

GoodBotVerifiedBOT

Collects public government procurement notices; identified, robots.txt-compliant, Web Bot Auth signed. Operated by Bidster.

GoodBot
Assessment
Academic Research
Category
BOT
Kind
1
Data sources
AI-generated summary, drawn from Cloudflare, operator docs, and community data

What is BidsterBot?

BidsterBot is a dedicated crawler operated by Bidster to aggregate government procurement notices from across the web. It utilizes a headless Chromium engine to render pages and extract structured data regarding public sector bidding opportunities. The bot is designed with high transparency, providing verifiable HTTP Message Signatures for every request and maintaining a public directory of its egress IP addresses.

Helpful — The bot operates transparently with clear identification, respects robots.txt, provides verifiable cryptographic signatures for its requests, and offers a direct opt-out mechanism.

Identification

Bot name
BidsterBot
Operator
Bidster
Category
Academic Research
Kind
BOT
Verification
Verified bot
Cloudflare slug
bidsterbot
Main use cases
Government procurement data aggregationTender opportunity monitoringPublic sector market research
Rated Oct 19, 2026 from public evidence

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly
Yes
Verified by Cloudflare
Yes
Says it follows robots.txt and opt-outs
Not stated
Ignores site rules
None found
Disguises itself or evades blocks
None found
Overloads sites
None found
How widely people complain
No complaint about this bot in the evidence
Reddit discussion
There is no Reddit discussion of this bot in the evidence

What we read

Why it crawls your site

The bot crawls to build a comprehensive, searchable database of government tenders, allowing users to track procurement opportunities efficiently. It adheres to strict politeness policies, including a maximum crawl rate of one request every two seconds per host and automatic back-off behavior. Site administrators can verify the bot's authenticity through its reverse DNS records, signed IP lists, or by checking the Ed25519 signature included in the request headers.

Block or allow BidsterBot

Block it

Add a Disallow rule for BidsterBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block BidsterBot from crawling your entire site
User-agent: BidsterBot
Disallow: /

# Allow BidsterBot full access
User-agent: BidsterBot
Allow: /
Allow & verify

Ensure your robots.txt allows BidsterBot. Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Links & references

Bidster documentation
bot.bidster.ai/bot
↗
Cloudflare Radar: BidsterBot
radar.cloudflare.com/traffic/bots/bidsterbot
↗

Data sources

This profile is compiled from the following sources.

CloudflareRadar
Last updated October 25, 2026

Something wrong with this entry? Suggest a correction