Directory/Categories/AI Assistant/Google-Agent

Google-Agent

GoodBotVerifiedBOT

Google-Agent is used by agents hosted on Google infrastructure to navigate the web and perform actions upon user request (e.g., Project Mariner). Operated by Google.

Operator website ↗

GoodBot

Assessment

AI Assistant

What is Google-Agent?

Google-Agent is a web crawler operated by Google. Google-Agent is used by agents hosted on Google infrastructure to navigate the web and perform actions upon user request (e.g., Project Mariner).

Helpful — Verified, safe crawler. Respects robots.txt and provides operator documentation.

Identification

Bot name

Google-Agent

Operator

Google

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly

Yes

Verified by Cloudflare

Yes

Says it follows robots.txt and opt-outs

Not stated

Ignores site rules

None found

Disguises itself or evades blocks

None found

Overloads sites

None found

How widely people complain

No complaint about this bot in the evidence

Reddit discussion

There is no Reddit discussion of this bot in the evidence

What we read

Why it crawls your site

Google-Agent crawls websites to collect and process web content. It is operated by Google as part of their web crawling infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.

IP ranges

Requests from Google-Agent originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.

Showing 24 of 317 ranges

Block or allow Google-Agent

Block it

Add a Disallow rule for Google-Agent in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block Google-Agent from crawling your entire site
User-agent: Google-Agent
Disallow: /

# Allow Google-Agent full access
User-agent: Google-Agent
Allow: /