Directory/Categories/Academic Research/ShaveIndexBot

ShaveIndexBot

GoodBotVerifiedBOT

Catalogues wet shaving products from manufacturer sites for shaveindex.com; respects robots.txt, signed requests.

Operator website ↗

GoodBot

Assessment

Academic Research

Identification

Bot name

ShaveIndexBot

Block or allow ShaveIndexBot

Block it

Add a Disallow rule for ShaveIndexBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block ShaveIndexBot from crawling your entire site
User-agent: ShaveIndexBot
Disallow: /

# Allow ShaveIndexBot full access
User-agent: ShaveIndexBot
Allow: /