Chris Meyer - Mentions » Webdevelopment http://chrismeyer.org/wordpress Mon, 09 Aug 2010 20:53:54 +0000 en hourly 1 http://wordpress.org/?v=3.3.1 Googlebot Crawl Rate for Blank Website http://chrismeyer.org/wordpress/2009/09/googlebot-crawl-rate-for-blank-website/ http://chrismeyer.org/wordpress/2009/09/googlebot-crawl-rate-for-blank-website/#comments Sat, 12 Sep 2009 22:54:22 +0000 Waterppk http://chrismeyer.org/wordpress/?p=162 I’ve got a blank site that I’ve had hosted for a while now and I was adding all of my websites to Google’s Webmaster tools. Interestingly the site crawl statistics tell us that Google’s bot will crawl a index.html only site (with no changes over 6 months of crawling) every 4.5 days.  If you take a look at the graph below, you’ll see the crawler looked at the page 20 time over 90 days, or every 4.5 days.  You can also see the variety of site response time from my host.

Google Crawler Frequency Statistics

Google Crawler Frequency Statistics

So for those of you paranoid about when Google will crawl your site next to get updates, it shouldn’t be more than 4.5 days assuming it’s not a brand new site.  The rest of my sites are crawled daily. . .

]]> http://chrismeyer.org/wordpress/2009/09/googlebot-crawl-rate-for-blank-website/feed/ 0