Comments on: Video: Crawl dates in the Google cache http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/ neat fun stuff Sat, 20 Mar 2010 04:13:22 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: Brian Cooper http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-115663 Brian Cooper Sun, 04 Nov 2007 11:03:10 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-115663 Hey Matt, Something small: could you please categorise this post as 'Movies/Videos'? :D I've recently started reading your blog and, well, keep up the good work! I particularly enjoyed the SEO issues you talked about in those videos you recorded back in 2006. Though, for some reason, when downloading clips from Google Video, the chances of me getting a file without it stopping at some point are about 50/50. Strange. Brian Hey Matt,

Something small: could you please categorise this post as ‘Movies/Videos’? :D

I’ve recently started reading your blog and, well, keep up the good work! I particularly enjoyed the SEO issues you talked about in those videos you recorded back in 2006. Though, for some reason, when downloading clips from Google Video, the chances of me getting a file without it stopping at some point are about 50/50. Strange.

Brian

]]> By: Gez http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-100741 Gez Fri, 30 Mar 2007 10:05:59 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-100741 Hello Matt, i have another question, how can i change the cache of a page? if i modify the content of a page, and google crawls the page the same day, when will the chache change? Hello Matt,

i have another question, how can i change the cache of a page?

if i modify the content of a page, and google crawls the page the same day, when will the chache change?

]]> By: curlygirl http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-89107 curlygirl Sat, 04 Nov 2006 02:15:01 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-89107 My page has been updated about 4 times in the past few months and it seems like google has not crawled it for about 9 months. So the cached version of my site now is extremely outdated. I had assumed that it would pick up the latest change i made, and the less recent change would show up in the cached version. However, this does not happen, and a really, really outdated version of my page shows up in the cached version. Why is this so? My page has been updated about 4 times in the past few months and it seems like google has not crawled it for about 9 months. So the cached version of my site now is extremely outdated. I had assumed that it would pick up the latest change i made, and the less recent change would show up in the cached version. However, this does not happen, and a really, really outdated version of my page shows up in the cached version. Why is this so?

]]> By: ted sullivan http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-87035 ted sullivan Thu, 28 Sep 2006 05:00:10 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-87035 Hi, Matt why is my site sometimes 254 pages, sometimes 165, sometimes 132.(using site:www.mysite.tld) In the google cache, when it is low the pages are missing. When it is high the pages are in the cache. How many caches are there anyway? This has been happening for 6 weeks and the changes seem to happen over night with no ryme or reason. Also the cache date for pages is sometimes back in May. But other days the same page has a cache date in August or September. How does this relate to the image you have with the cahce date circled in red. Hi, Matt why is my site sometimes 254 pages, sometimes 165, sometimes 132.(using site:www.mysite.tld) In the google cache, when it is low the pages are missing. When it is high the pages are in the cache. How many caches are there anyway? This has been happening for 6 weeks and the changes seem to happen over night with no ryme or reason.

Also the cache date for pages is sometimes back in May. But other days the same page has a cache date in August or September. How does this relate to the image you have with the cahce date circled in red.

]]> By: DamonHD http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86918 DamonHD Tue, 26 Sep 2006 10:56:01 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86918 Hi Matt, In your efforts to save bandwidth/trees/whales/etc, do you also make use of the Content-MD5 (and Content-Length) header to avoid fetching mirrored data? I happen to provide this for my (often large) multimedia exhibits and it would be nice if G could realise/guess that with the same URL suffix, length, last-mod date and domain that it does not need to fetch the mirrored content at all. This would mean you could still direct local users to their local mirrored copy but save us all lots of bandwidth/trees/karma/etc. (Obviously you'd want to verify the content on a random sample to avoid black-hattery...) Rgds Damon Hi Matt,

In your efforts to save bandwidth/trees/whales/etc, do you also make use of the Content-MD5 (and Content-Length) header to avoid fetching mirrored data? I happen to provide this for my (often large) multimedia exhibits and it would be nice if G could realise/guess that with the same URL suffix, length, last-mod date and domain that it does not need to fetch the mirrored content at all. This would mean you could still direct local users to their local mirrored copy but save us all lots of bandwidth/trees/karma/etc. (Obviously you’d want to verify the content on a random sample to avoid black-hattery…)

Rgds

Damon

]]> By: Hanford http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86596 Hanford Wed, 20 Sep 2006 06:37:26 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86596 Sorry to chime in so late with this but I thought I'd share it. The old method of showing the date allowed me to use the cache as a kind of "has this page recently changed?" tool. I can't do that anymore. No big deal, but there ya go. Sorry to chime in so late with this but I thought I’d share it. The old method of showing the date allowed me to use the cache as a kind of “has this page recently changed?” tool. I can’t do that anymore. No big deal, but there ya go.

]]> By: Luis Filipe Fabiani http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86225 Luis Filipe Fabiani Tue, 12 Sep 2006 15:56:13 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86225 Matt, check out number 7 at http://www.ericward.com/linkmoses/ten.html Matt, check out number 7 at http://www.ericward.com/linkmoses/ten.html

]]> By: Ian http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86213 Ian Tue, 12 Sep 2006 09:46:23 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86213 Now you've gone and made me hungry... Now you’ve gone and made me hungry…

]]> By: Brent D. Payne http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86102 Brent D. Payne Sun, 10 Sep 2006 21:27:55 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-86102 Since the middle of August I have had about 100,000 pages in the Google index (finally). However every 6 - 8 days the number of pages in the index drops to about 100 - 350 pages. It stays that way for about 12 - 18 hours and then bounces back up to almost 200,000 pages and then 12 - 18 hours more, drops back to around 100,000 pages and stays consistant. What the heck is causing this? Also, my server doesn't have a sound card and my laptop's hard drive sounds like someone took a hammer to it (grinds horribly) so wasn't able to watch you video yet, can you tell me if the date I have on every page of my site (http://www.lyricvault.com) will cause any issues regarding caching of my pages? Last thing, I have a lyrics page for every song for sale in the U.S. (depending on when I last updated the db, do it about every two weeks or so) however only 300,000 or so actually have the lyrics on them (the purpose of the site). I am noticing that a lot of people that land on a lyric page that has no lyrics will submit them (I try to make it real easy for them) however it will take weeks or months for Google to update their cache of the new content on the page (i.e. the added song lyrics). Is there something I can do to tell Google with a big red neon sign that the page has significantly changed and the change is paramount to the purpose of the site so please update the cache on the sucker? Thanks a million, Brent Since the middle of August I have had about 100,000 pages in the Google index (finally). However every 6 – 8 days the number of pages in the index drops to about 100 – 350 pages. It stays that way for about 12 – 18 hours and then bounces back up to almost 200,000 pages and then 12 – 18 hours more, drops back to around 100,000 pages and stays consistant.

What the heck is causing this?

Also, my server doesn’t have a sound card and my laptop’s hard drive sounds like someone took a hammer to it (grinds horribly) so wasn’t able to watch you video yet, can you tell me if the date I have on every page of my site (http://www.lyricvault.com) will cause any issues regarding caching of my pages?

Last thing, I have a lyrics page for every song for sale in the U.S. (depending on when I last updated the db, do it about every two weeks or so) however only 300,000 or so actually have the lyrics on them (the purpose of the site). I am noticing that a lot of people that land on a lyric page that has no lyrics will submit them (I try to make it real easy for them) however it will take weeks or months for Google to update their cache of the new content on the page (i.e. the added song lyrics). Is there something I can do to tell Google with a big red neon sign that the page has significantly changed and the change is paramount to the purpose of the site so please update the cache on the sucker?

Thanks a million,

Brent

]]> By: Teddie http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-85438 Teddie Sat, 09 Sep 2006 22:46:37 +0000 http://www.mattcutts.com/blog/video-crawl-dates-in-the-google-cache/#comment-85438 We have been experimenting with building a crawler ourselves this year, I reckon everyone in the SEO sphere should do it for the experience. I now have a LOT more empathy for what your crawler team must go through on a daily basis and the sort of issues you face and why...darn people do some dumb stuff into their URLs and server configs. 1337 - h0\/\/ c0/\/\3 1 n3v3r 590773d 7h15 b4? http://www.google.com/intl/xx-hacker/ v.7unny We have been experimenting with building a crawler ourselves this year, I reckon everyone in the SEO sphere should do it for the experience. I now have a LOT more empathy for what your crawler team must go through on a daily basis and the sort of issues you face and why…darn people do some dumb stuff into their URLs and server configs.

1337 – h0\/\/ c0/\/\3 1 n3v3r 590773d 7h15 b4?
http://www.google.com/intl/xx-hacker/
v.7unny

]]>