Directory/Categories/AI Assistant/RecordsLabsIngestion

RecordsLabsIngestion

GoodBotVerifiedAGENT

Crawls customer-selected sites for private search and RAG. Records Labs does not train models on crawled content.

Operator website ↗

GoodBot

Assessment

AI Assistant

Identification

Bot name

RecordsLabsIngestion

Block or allow RecordsLabsIngestion

Block it

Add a Disallow rule for RecordsLabsIngestion in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block RecordsLabsIngestion from crawling your entire site
User-agent: RecordsLabsIngestion
Disallow: /

# Allow RecordsLabsIngestion full access
User-agent: RecordsLabsIngestion
Allow: /