i-search-crawler

Add a Disallow rule for i-search-crawler in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block i-search-crawler from crawling your entire site
User-agent: i-search-crawler
Disallow: /

# Allow i-search-crawler full access
User-agent: i-search-crawler
Allow: /

Ensure your robots.txt allows i-search-crawler. Verify requests by checking the user-agent string.