pww-bot
GoodBotVerifiedAGENTA web crawler operated by Perplexity AI used to gather information for their AI-powered answer engine. Operated by Perplexity AI.
What is pww-bot?
pww-bot is an automated agent deployed by Perplexity AI to traverse the web and ingest content for their conversational search engine. By indexing pages, the bot enables the platform to synthesize real-time information and provide cited, accurate responses to complex user queries. It functions as a core component of Perplexity's infrastructure, ensuring their models have access to current data without relying solely on third-party search indexes.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Crawlers not respecting robots.txt, need to block access.
- google ignoring robots.txt ? - Google Search Central Community
- Why are Bing and SEMRushBot ignoring crawl-delay in my robots.txt file?
- How Google Interprets the robots.txt Specification | Google Crawling Infrastructure | Crawling infrastructure | Google for Developers
- HUMAN and TollBit Empower Websites with Robust Bot Management and Content Monetization Solutions for AI Agents
Why it crawls your site
The primary purpose of pww-bot is to maintain a fresh and comprehensive index of the internet to support Perplexity's answer engine. It crawls websites to extract text, metadata, and context, which are then processed to generate direct answers for users. Site owners can verify the bot's legitimacy by checking its User-Agent string and ensuring it originates from Perplexity's known IP ranges, and they can manage its access via standard robots.txt directives.
Block or allow pww-bot
Add a Disallow rule for pww-bot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block pww-bot from crawling your entire site User-agent: pww-bot Disallow: / # Allow pww-bot full access User-agent: pww-bot Allow: /
Ensure your robots.txt allows pww-bot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Related bots
Other crawlers operated by Perplexity AI.
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction