---
title: "Setting a Crawl Delay in Google Webmaster Tools"
description: "Google just like any other search engine needs to send crawlers to your website in order to index the information. Search engines can crawl your website too fast, and you can block search engines..."
url: https://www.inmotionhosting.com/support/website/google-tools/setting-a-crawl-delay-in-google-webmaster-tools/
date: 2011-12-06
modified: 2023-06-12
author: "InMotion Hosting Contributor"
categories: ["Google Tools"]
type: post
lang: en
---

# Setting a Crawl Delay in Google Webmaster Tools

Google just like any other search engine needs to send crawlers to your website in order to index the information.

Search engines can crawl your website too fast, and you can [block search engines from crawling your website](/support/website/how-to-stop-search-engines-from-crawling-your-website/).

With Google, you typically want them to crawl your site, but at a reduced rate so they aren’t slamming your server.

If you don’t already have a Google account you should read our [introduction to Google Webmaster Tools](/support/website/google-tools/introduction-to-google-webmaster-tools/) article.

## Changing Google’s crawl rate in Webmaster Tools

Adjusting the crawl rate for Google won’t affect ranking, just how long it takes them to index your entire website.

If you had 1,000 pages on your website, a search engine could potentially index your entire site in a few minutes.

However this could cause [high system resource usage](/support/website/what-is-high-system-resource-usage/) with all of those pages loaded in a short time period.

A **Crawl-delay:** of **30** seconds would allow crawlers to index your entire 1,000 page website in just **8.3 hours**

A **Crawl-delay:** of **500** seconds would allow crawlers to index your entire 1,000 page website in **5.8 days**

Using the steps below you can adjust Google’s crawl rate for your website using Webmaster Tools:

[![Google Webmaster tools login](/support/images/stories/webmaster_tools/update/sign-in-to-webmaster-tools.png)](/support/images/stories/webmaster_tools/update/sign-in-to-webmaster-tools.png)

**Step 1**

Log in to [Google Webmaster Tools](/support/website/google-tools/introduction-to-google-webmaster-tools/)

[![Webmaster tools list of sites](/support/images/stories/webmaster_tools/crawl-delay/click-on-site-to-manage.png)](/support/images/stories/webmaster_tools/crawl-delay/click-on-site-to-manage.png)

**Step 2**

Click on the website you’d like to manage

[![Site Settings link](/support/images/stories/webmaster_tools/crawl-delay/click-on-settings-cog-then-site-settings.png)](/support/images/stories/webmaster_tools/crawl-delay/click-on-settings-cog-then-site-settings.png)

**Step 3**

Click the top-right settings cog, then **Site Settings**

[![Webmaster tools site settings](/support/images/stories/webmaster_tools/crawl-delay/click-on-limit-googles-max-crawl-rate-set-rate-hit-save.png)](/support/images/stories/webmaster_tools/crawl-delay/click-on-limit-googles-max-crawl-rate-set-rate-hit-save.png)

**Step 4**

Click on **Limit Google’s maximum crawl rate**

Adjust the crawl rate to at least **30 seconds** apart.

[![Webmaster tools save confirmation](/support/images/stories/webmaster_tools/crawl-delay/changes-saved-for-90-days.png)](/support/images/stories/webmaster_tools/crawl-delay/changes-saved-for-90-days.png)

**Step 5**

Crawl delay settings are only saved for **90 days**.

Note down the date you’ll need to set them again

Now the next time Google sends their Googlebot crawler to index your website, they’ll be sure to space out their requests at least 30 seconds in-between each other.
