Directory/Categories/Security/ProjectShield Url Check

ProjectShield Url Check

Name: ProjectShield Url Check
Author: Google

GoodBotVerifiedBOT

Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digital attack used to censor information by taking websites offline. Operated by Google.

Operator website ↗

GoodBot

Assessment

Security

What is ProjectShield Url Check?

ProjectShield Url Check is a web crawler operated by Google. Project Shield, created by Google Cloud and Jigsaw and powered by Google Cloud Armor, provides free unlimited protection against DDoS attacks, a type of digital attack used to censor information by taking websites offline.

Helpful — Verified, safe crawler. Respects robots.txt and provides operator documentation.

Identification

Bot name

ProjectShield Url Check

Operator

Google

Why it crawls your site

ProjectShield Url Check crawls websites to scan for security vulnerabilities and potential threats. It is operated by Google as part of their security infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.

IP ranges

Requests from ProjectShield Url Check originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.

Showing 24 of 311 ranges

Block or allow ProjectShield Url Check

Block it

Add a Disallow rule for ProjectShield-UrlCheck in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block ProjectShield Url Check from crawling your entire site
User-agent: ProjectShield-UrlCheck
Disallow: /

# Allow ProjectShield Url Check full access
User-agent: ProjectShield-UrlCheck
Allow: /

Allow & verify

Ensure your robots.txt allows ProjectShield-UrlCheck. Verify requests are genuine by checking the user-agent string and referring to Google's documentation.