Directory/Categories/SEO/SiteGuru

SiteGuru

GoodBotVerifiedBOT

SiteGuru is an SEO auditing tool that crawls Operated by SiteGuru.

Operator website ↗

GoodBot

Assessment

SEO

What is SiteGuru?

SiteGuruCrawler is the dedicated web crawler for SiteGuru, a Netherlands-based SEO platform designed to provide actionable insights for website optimization. The bot systematically traverses websites to gather data for technical audits, including indexation status, structured data validation, and Core Web Vitals monitoring. By identifying issues such as broken links, missing meta tags, and hreflang errors, it enables site owners and agencies to improve their search engine visibility and user experience.

Helpful — This bot performs authorized website audits to help site owners identify technical SEO issues, broken links, and performance bottlenecks.

Identification

Bot name

SiteGuru

Operator

SiteGuru

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly

Yes

Verified by Cloudflare

Yes

Says it follows robots.txt and opt-outs

Not stated

Ignores site rules

None found

Disguises itself or evades blocks

None found

Overloads sites

None found

How widely people complain

No complaint about this bot in the evidence

Reddit discussion

There is no Reddit discussion of this bot in the evidence

What we read

Why it crawls your site

The crawler operates specifically to fulfill user-initiated requests within the SiteGuru platform. When a user adds a domain to their SiteGuru dashboard, the crawler is triggered to map the site's structure and analyze individual pages against a suite of SEO best practices. This data is then processed to generate a prioritized to-do list for the site owner, ensuring that the audit reflects the current state of the website's content and technical configuration.

Block or allow SiteGuru

Block it

Add a Disallow rule for SiteGuruCrawler in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block SiteGuru from crawling your entire site
User-agent: SiteGuruCrawler
Disallow: /

# Allow SiteGuru full access
User-agent: SiteGuruCrawler
Allow: /