The loading time of a site therefore really

Afrin123

Is the Google crawl a really important SEO indicator to take into account and optimize? How does Google allocate a crawl budget per site? Google has just provided some answers to frequently asked questions about the crawl of a site by Google and the calculation of the crawl budget. Quick access (Summary): Google crawl optimization: an interest for all sites? According to Google , if a site has fewer than a few thousand pages, the webmaster should (most of the time) not have to worry about Google crawling their site.

Google's crawl optimization is a practice that is especially Specific Database interesting for large sites (over 10,000 indexed pages) and those that dynamically generate new URLs based on parameters. What is the crawl budget and how is it allocated? The crawl budget allocated to a site depends on several factors: Site response time : the faster the server responds (fast site to load), the more Googlebot will be able to crawl a large volume of pages simultaneously. Possible limits configured in Search Console .



Basically, Google itself optimizes the rate at which it will crawl a site according to its response time. If the response time is very fast, the crawl speed will be higher, conversely, if the server is slow, Google will slow down the crawl speed. However, from the “Site Settings” section in Search Console , webmasters can ask Google to lower its maximum crawl speed. They can also configure the maximum crawl rate acceptable to their server. The volume of popular pages to crawl : Google tends to crawl popular pages much more frequently than less popular pages so that they are as up to date as possible in the index possible (eg popular page: home).