Perplexity's crawler, which indexes and fetches web pages so they can be retrieved and cited in its answers.
ID
SS-DF-108
Confidence
Established · 76
Evidence
Established
Updated
2026-07-08
Definition
Perplexity's crawler, which indexes and fetches web pages so they can be retrieved and cited in its answers.
PerplexityBot gathers and fetches content that Perplexity's answer engine draws on when composing cited responses. Because Perplexity is retrieval-first and shows its sources, allowing this crawler and keeping pages accessible is a direct prerequisite for appearing in its answers. Blocking it removes a transparent, fast-growing channel where you can clearly observe which of your pages earn citations.