Crawl Budget
The number of pages a bot will crawl on a site within a given time, based on the site's size, speed, and authority.
Detailed Explanation
Crawl budget refers to the limited amount of time and resources a search engine or AI crawler allocates to crawling a given website. Large or slow sites with many low-value pages can exhaust their crawl budget before important pages get (re)crawled, delaying how quickly new or updated content is picked up.
Why It Matters
A wasted crawl budget means fresh content, including updates meant to correct outdated AI answers, may take far longer to be seen and reflected.
Example
Related FAQs
We're updating this category. Come back soon.
