GLOSSARY TERM
What is Crawl Budget?
Definition
The number of URLs a search engine bot will crawl on your site within a given period. Determined by site authority, server speed, and content freshness.
Why it Matters for AI Search
Wasting crawl budget on duplicate pages, faceted URLs, or noindex content means important pages get crawled less often. Sites with millions of URLs need active crawl budget management; small sites usually don't.
Related Terms
Browse all 105 terms →See if your site is optimized.
Run a free AI Search Readiness scan to detect missing JSON-LD schema, poor Core Web Vitals, and more.
Scan My Website