The number of URLs a search engine is willing and able to crawl on a site within a given period.
ID
SS-DF-018
Confidence
High · 88
Evidence
Established
Updated
2026-07-08
Definition
The number of URLs a search engine is willing and able to crawl on a site within a given period.
Crawl budget is the practical limit on how many pages a search engine will fetch from a site, shaped by crawl rate (how hard it can hit the server without harm) and crawl demand (how much it wants to). It matters most for large sites, where wasting budget on low-value URLs such as filtered listings or session parameters can leave important pages uncrawled and unindexed. Efficient internal linking, clean URL structures and controlling low-value paths help direct budget to pages that matter.