Directory/Categories/Feed Fetcher/SemanticHubBot

SemanticHubBot

GoodBotVerifiedBOT

Fetches RSS feeds and articles from sources chosen by SemanticHub users. Respects robots.txt and rate limits.

Operator website ↗

GoodBot

Assessment

Feed Fetcher

Identification

Bot name

SemanticHubBot

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly

Yes

Verified by Cloudflare

Yes

Says it follows robots.txt and opt-outs

Yes

Ignores site rules

None found

Disguises itself or evades blocks

None found

Overloads sites

None found

How widely people complain

No complaint about this bot in the evidence

Reddit discussion

There is no Reddit discussion of this bot in the evidence

What we read

Block or allow SemanticHubBot

Block it

Add a Disallow rule for SemanticHubBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block SemanticHubBot from crawling your entire site
User-agent: SemanticHubBot
Disallow: /

# Allow SemanticHubBot full access
User-agent: SemanticHubBot
Allow: /