Directory/Categories/Security/Arachnid Shield API

Arachnid Shield API

Name: Arachnid Shield API
Author: Canadian Centre for Child Protection

GoodBotVerifiedAGENT

Fetches a media file upon request of the domain owner and scans it for CSAM. Operated by Canadian Centre for Child Protection.

Operator website ↗

GoodBot

Assessment

Security

What is Arachnid Shield API?

Arachnid Shield API is a web crawler operated by Canadian Centre for Child Protection. Fetches a media file upon request of the domain owner and scans it for CSAM.

Helpful — Verified, safe crawler. Respects robots.txt and provides operator documentation.

Identification

Bot name

Arachnid Shield API

Operator

Canadian Centre for Child Protection

Why it crawls your site

Arachnid Shield API crawls websites to scan for security vulnerabilities and potential threats. It is operated by Canadian Centre for Child Protection as part of their security infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.

Block or allow Arachnid Shield API

Block it

Add a Disallow rule for Arachnid Shield in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block Arachnid Shield API from crawling your entire site
User-agent: Arachnid Shield
Disallow: /

# Allow Arachnid Shield API full access
User-agent: Arachnid Shield
Allow: /

Allow & verify

Ensure your robots.txt allows Arachnid Shield. Verify requests are genuine by checking the user-agent string and referring to Canadian Centre for Child Protection's documentation.