PerplexityBot/1.0

UndecidedCommunity-sourced

PerplexityBot/1.0 is a web crawler operated by Perplexity, designed to index and link websites in Perplexity's search results. Its user-agent string is Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot) . ( docs.perplexity.ai ) Unlike some other crawlers, PerplexityBot is not used to collect content for training AI foundation models. Instead, it focuses on gathering information to enhance the relevance and accuracy of search results on Perplexity's platform. ( docs.perplexity.ai ) PerplexityBot respects the robots.txt directives of websites. If a site disallows PerplexityBot via robots.txt , the crawler will not index the full or partial text content of that site. However, even if a page is blocked, PerplexityBot may still index the domain, headline, and a brief factual summary. ( perplexity.ai ) To ensure your site appears in Perplexity's search results, it's recommended to allow PerplexityBot in your site's robots.txt file and permit requests from its published IP ranges. ( docs.perplexity.ai )

Operator website ↗

Undecided

Assessment

Uncategorized

Identification

Bot name

PerplexityBot/1.0

IP ranges

Requests from PerplexityBot/1.0 originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.

Block or allow PerplexityBot/1.0

Block it

Add a Disallow rule for Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block PerplexityBot/1.0 from crawling your entire site
User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
Disallow: /

# Allow PerplexityBot/1.0 full access
User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
Allow: /

Allow & verify

Ensure your robots.txt allows Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot). Verify requests by checking the user-agent string.