Evidence GEO & AI Search

PerplexityBot is the search crawler; Perplexity-User is a separate user-triggered fetcher

Perplexity documents PerplexityBot as its robots-controlled search crawler and Perplexity-User as a separate user-triggered fetcher that generally ignores robots.txt.

ID
SS-EV-046
Confidence
High · 96
Evidence
Strong
Updated
2026-09-20

The claim

PerplexityBot should be handled as a search crawler. Perplexity-User should be tested and controlled at the network edge rather than treated as a normal robots.txt crawler.

What the evidence shows

Perplexity's crawler documentation says PerplexityBot is designed to surface and link websites in search results and recommends allowing it in robots.txt. The same documentation says Perplexity-User supports user-requested page visits, is not a web crawler or training agent, and generally ignores robots.txt because the fetch was user initiated. Perplexity also says crawler-setting changes may take up to 24 hours to reflect.

Source

Source
Perplexity crawler documentation and 2026 search architecture
Type
Provider documentation
Year
2026
Strength
Strong

How SearchScore applies it

Recommended next steps

    Apply the method Crawlability Framework Framework See the wider capability AI Visibility Optimisation Capability