Directory/Categories/Search Engine Crawler/WebAtlasRssSitemapBot

WebAtlasRssSitemapBot

GoodBotVerifiedBOT

Reads RSS, Atom feeds and sitemaps to feed the global indexing queue while respecting robots.txt directives.

Operator website ↗

GoodBot

Assessment

Search Engine Crawler

Identification

Bot name

WebAtlasRssSitemapBot

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly

Yes

Verified by Cloudflare

Yes

Says it follows robots.txt and opt-outs

Yes

Ignores site rules

None found

Disguises itself or evades blocks

None found

Overloads sites

None found

How widely people complain

No complaint about this bot in the evidence

Reddit discussion

There is no Reddit discussion of this bot in the evidence

What we read

Block or allow WebAtlasRssSitemapBot

Block it

Add a Disallow rule for WebAtlasRssSitemapBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block WebAtlasRssSitemapBot from crawling your entire site
User-agent: WebAtlasRssSitemapBot
Disallow: /

# Allow WebAtlasRssSitemapBot full access
User-agent: WebAtlasRssSitemapBot
Allow: /