Directory/Categories/Academic Research/RegLensScraper

RegLensScraper

GoodBotVerifiedBOT

Reads public government regulatory material for a compliance product. Respects robots.txt and crawl-delay.

Operator website ↗

GoodBot

Assessment

Academic Research

Identification

Bot name

RegLensScraper

Block or allow RegLensScraper

Block it

Add a Disallow rule for RegLensScraper in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block RegLensScraper from crawling your entire site
User-agent: RegLensScraper
Disallow: /

# Allow RegLensScraper full access
User-agent: RegLensScraper
Allow: /