Comments on: Boston Pubcon 2006, Day 1

By: ECVV

ECVV — Tue, 19 Sep 2006 04:13:24 +0000

hi,i just wondered if adsense can improve our site’s poor indexing and found matt’s this answer “But there’s no boost at all in rankings if you’re in AdSense or Google News. You don’t get any more pages crawled either.” then i quit the idea to get adsense in our site, thanks.

By: Jal

Jal — Fri, 02 Jun 2006 11:35:32 +0000

Hi matt,

I have one question on media bot . I have not allowed any of the crawler in my robots.txt file so is media bot ll crawl my pages?

I am going to update my site so i dnt want allow crawlwer’s to crawl .PHP pages so if I do so

User-agent: Googlebot
Disallow: *.php$

Then mediabot ll crawl tht pages or not coz both the bots are diffrent.

Regards,
Jal.

By: Sandra

Sandra — Tue, 02 May 2006 19:20:09 +0000

boston has nice flowers. your comment box functionality is great. nice site design too.

By: Manish

Manish — Fri, 21 Apr 2006 13:09:41 +0000

Great Post Matt, WIFI is just great , am loving it.

By: Mike

Mike — Fri, 21 Apr 2006 00:25:32 +0000

Matt

How about sending Googlebot to a different server to enable it to crawl smoothly and avoid putting pressure to the servers that users see?

I am talking about serving exactly the same content here. This is cloacking, is it bad though?

Many thanks

By: Chris Boggs

Chris Boggs — Thu, 20 Apr 2006 16:41:11 +0000

Thanks Matt for the nice coverage. Perhaps you would like to help out SER with the next SES coverage? :p

Just to get things nice and clear, are you saying that the Googlebot can tell if unique content is being delivered to any of its IP’s during a crawl? I understand if this would be considered too much to elaborate on. I also hope that you weren’t trying to elicit additional information from Mike through the use of any red liquids…

Any chance you could be a little more specific in terms of Daron’s “chicklet inflation” warning? Does this mean that automated activities (bots?) may click on those features and if so what is the problem with that? This is what it seems like to me due to Daron’s briefly described solution.

By: Eric Giguere

Eric Giguere — Thu, 20 Apr 2006 11:08:30 +0000

Thanks, Matt, that's what I was assuming it was -- "AdSense pull" and not "AdSense push" (see my blog for the diagrams showing what I mean). Hopefully this will cause the fuss to die down now....

By: Matt Cutts

Matt Cutts — Thu, 20 Apr 2006 07:17:37 +0000

Danny, thanks for the info–good to know. Sorry that I got that wrong.

Eric, I talked about mediabot more today and even made a couple PowerPoint slides. I may post about this more when I get back from WMW, but: pages with AdSense will not be indexed more frequently. It’s literally just a crawl cache, so if e.g. our news crawl fetched a page and then Googlebot wanted the same page, we’d retrieve the page from the crawl cache. But there’s no boost at all in rankings if you’re in AdSense or Google News. You don’t get any more pages crawled either.

By: Harith

Harith — Thu, 20 Apr 2006 06:48:23 +0000

Good morning Matt

Would you be kind to elaborate more on what tedster said on WMW that:
“Matt Cutts mentioned that some new things were going to being worked with at 64.233.187.104 — and also at 72.14.203.104″

Thanks.

By: kirby

kirby — Thu, 20 Apr 2006 04:51:18 +0000

>I wouldnt advise disagreeing…

No sense arguing with the cuttlets, Garywolf. They are the new self appointed arbitrators of spam as it relates to Google guidelines. Their motto: “Learn it, love it, live it.”