Directory/Categories/Academic Research/TheRealRegBot

TheRealRegBot

GoodBotVerifiedBOT

Reads used-car adverts on UK dealers' own websites so buyers can see a car's advert history. Obeys robots.txt.

Operator website ↗

GoodBot

Assessment

Academic Research

Identification

Bot name

TheRealRegBot

Block or allow TheRealRegBot

Block it

Add a Disallow rule for TheRealRegBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block TheRealRegBot from crawling your entire site
User-agent: TheRealRegBot
Disallow: /

# Allow TheRealRegBot full access
User-agent: TheRealRegBot
Allow: /