Archives for February 2007

Got malware? Google will help you find it.

A while ago I did a post about a site that was getting the malware interstitial on Google. They said “We don’t have any bad software on our domain” and I was all, like, “Psst, buddy, check out these urls.” But that’s not really a scalable approach. 🙂

Now the webmaster console team has added a “please show me some urls that Google thinks are bad” feature. Much more scalable, and it should be a big help to webmasters that might have gotten a few pages hacked. I’ve updated my original post and said:

Looks like the webmaster console team has now added example urls for sites that we think are hosting malware. This is a great step to give webmasters more tools to self-diagnose any malware-related issues with their site. As always, thanks to the folks who added this feature.

Not much more to say about it. If you do see that malware interstitial page for one of your sites, hit Webmaster Central to get more info. Barry’s got a bit more detail up about it over here as well.

Misc bits

I’m mostly caught up on my feeds. It was relatively quiet the last couple weeks, but I’ve seen 2-3 things I wanted to talk about in the last couple days or so.

First, WebProNews ran this post that claims that Google is selling PageRank 7 links.

My quick take: when you dig into it, it turns out that it’s a Google directory of enterprise companies that can do things like write plug-ins for proprietary data types for the Google Search Appliance, merge geospatial GIS data, and integrate telephony products with Google Apps. This is a program for enterprise companies, and I don’t think anyone has even suggested before now that this directory could be construed as selling links, but just to avoid even the appearance of anything improper, I’ve already submitted a change to ensure that there’s no PageRank benefit from these links. I left a comment on the original post; I wish that WebProNews would show comments on their blog partner program. Right now, someone would read that article, but wouldn’t know that there are any comments (including mine) on the original post.

Next, Elinor Mills wrote about an interesting allegation. I’ll include the whole content of the allegation: [Just to clarify, this is an allegation that Elinor is passing on from a newsletter, not a claim that Elinor is making herself directly.]

In the past, when you launched a website, or Google wasn’t picking up your stuff, you could call the friendly people over there and they’d look at your website to see if you were legit, look at their search results, and adjust their code appropriately. It used to be this all occurred in the same day. Then it was 24 hours. So, imagine our dismay when wasn’t even being picked up two weeks after we launched. We had called Google two days into the launch and they apologized, saying their search engines were backlogged with so many sites to monitor. We called after a week and then called again and again, with no better answer. We even tried posting ads with Google and they couldn’t find us. “Clearly, we had tried their patience, as in the end they threatened to BLACKLIST our websites so no one would ever find us again. Now is that power or what? Funny thing is, Yahoo found us faster and more reliably. So, Google is no longer my home page. More importantly, they are showing all the signs of a monopolist trying to forcibly extract revenues for nothing. Whenever this happens, it’s a sign that revenue growth has peaked and they are trying to force it in order to maintain high stock valuations. So watch out if you are an investor

When Elinor asked for a comment about this, several of us read the original complaint, and I have to admit that we were perplexed. Google doesn’t provide phone support for webmasters; as Vanessa Fox recently noted, over 1 million webmasters have signed up for our webmaster console alone, so offering phone support for every site owner in the world wouldn’t really scale that well. They talk about buying ads later in the paragraph; we wondered “maybe they were talking to phone support for AdWords?” But I can’t imagine anyone at Google on the ads side or anywhere else saying our search engines were backlogged with too many sites to monitor. The Google index is designed to scale to billions of webpages, and it does that job pretty well. It’s even harder for me to imagine anyone at Google saying on the phone that they would “BLACKLIST our websites so no one would ever find us again,” because again, we don’t provide webmaster support over the phone, and I believe AdWords phone support would know better than to claim our index was backlogged or to threaten to remove anyone’s site from our index. Maybe a call to AdWords support reached such a fever pitch that a representative declined to run an ad?

At any rate, I’m sorry for any negative interactions that had with Google. The current description of the issue doesn’t give enough concrete details to check out, but if anyone from that domain wanted to clarify or to provide emails or dates/times/names of phone calls (did they call AdWords? Randomly try to hop into the Google phone tree? Talk to a receptionist?), I’d be happy to try to look into it more.

In the absence of more details about their interaction, I tried to dig more into the crawling of I didn’t see any negative issues (no spam penalties or anything like that) for the domain. I saw attempts to crawl the site as far back as October 2006, but that earliest attempt got an authentication crawl error (that would have been a 401 or a 407 HTTP status code). I believe that this allegation went out Feb. 2nd, and I believe we had at least one page from that site at that point. I did notice that visiting the root page of the domain gives a 302 (temporary) redirect to the HTTPS version of the domain. That’s kinda unusual, but we should still be able to crawl that.

The other thing to look at is current coverage. Here’s what I saw:

Search Engine Number of pages
Google over 450+ pages
Yahoo 1 page
Live about 176 pages
Ask 0 pages

(Note that if you just do [] on MSN/Live, you might get results estimates as high as 500+ results, but the way to verify results estimates is to go to the final page of results, and MSN/Live stops after 176 results.)

It looks like Google crawls at least as deeply as any other major search engine. I’m still confounded who the folks at could have talked to at Google, but I’ll leave open the offer to dig into it more if they want to provide more details. And I’ll wish them well for their new domain in the future.

Moving on, I got a kick out of this one. In the “can’t win for losing” department, there’s this post. Someone going by the handle “earlpearl” pointed out a thread to Barry Schwartz, in which someone reported that Google Maps had incorrect info for Duke Medical Center. The good news is earlpearl mentions a few hours later that the info has been corrected. Everybody’s happy, right? Nope, someone with the handle INFO (which I think is the same person as earlpearl) posts to the thread and says:

I see that Google Maps corrected this information in one day. I’m still
trying to learn how the bad information I submitted can be corrected.

Looks to me like Google only responds to large institutions!

So Google got criticized for having bad info for a medical center. It sounds like someone at Google took action quickly, but then we got criticized for only responding to large institutions. Personally, I think if you’re going to correct bad information, medical centers are one of the first places I would tackle. 🙂 There is an ironic twist on this. I think earlpearl/INFO is partially frustrated because they’ve reported outdated info regarding some bartending schools, and that data hasn’t been changed yet. But the twist is that earlpearl’s thread about bartending schools has gotten two personal responses from a Google employee (“Maps Guide Jen”). Jen’s most recent reply struck me as pretty responsive:


Thank you so much for all this detailed information. We’ll look into your
reports further to try and track down where our data might be outdated. I
definitely appreciate your taking the time on this!


My hope is that we’ll check into earlpearl’s report as well and then everyone will be happy. 🙂

Those were 2-3 semi-negative posts that I wanted to give a quick take on. Just so that people don’t get down thinking that every post is negative about Google, here’s a really interesting post by Bill Slawski of SEO by the SEA. Bill pulls together mentions of twelve different Googlers who have made nice contributions to Open Source or open standards. I know of several other Googlers who help open-source projects and who aren’t on that list; it’s good to be reminded that Google contributes to the open source movement in a lot of ways.

Update: Clarified the post to note that Elinor didn’t write the allegation I quote up above; she found it from a newsletter and is passing it on to her readers. Thanks for pointing out that my language wasn’t clear, Philipp. 🙂

About to board the plane back..

In 30 minutes I’ll be on a plane back to San Francisco. Gawd, I wish they had WiFi on planes right now. Can you imagine 10 extra hours to surf, catch up on different things, and generally enjoy the web?

Maybe in a couple more years. Anyway, I’m sure I’ll be doing posts when I get back to talk about several of the interesting things (and people!) that I ran into.

I’m in Dublin..

Not so much blog posting this week, as I’m trying to get as much as I can from visiting Dublin. I’ll talk about more later.

Highlight so far include
– meeting lots of fantastic Google colleagues in the Dublin office. It was hard to tear myself away today because I was having such a good time talking to people.
– visiting the Guiness Storehouse.
– taking a short train ride to Howth this weekend.

I’ll try to get some pictures and comments about SES London up at some point.

I won the lottery!

Holy crap! I’ve only been in the UK for a day or so, and I already won their national lottery! They just alerted me by email:

Dear winner
We are pleased to inform you of the final announcement of the UK
National Lottery Online thunderball Programme with draw numbers(#625)
01, 18,22,23,,31 05. held on 6th Wed February, 2007.

which subsequently won you the lottery of the Jackpot Prize.You have
therefore been approved to claim a total sum of £1,00,000 (One million pounds sterling). in cash credited to file
KTU/9023118308/03.All participants for the online version were selected
randomly from World Wide Web sites through computer draw system
.Europeanbooklet representative office in Europe as indicated in your
play coupon. In view of this, your £1,00,000 would be released to you
by any of our payment offices in Europe.

Our European agent will immediately commence the process to
facilitate the release of your funds as soon as you contact him.
To file for your claim, please contact our fudiciary agent:

Contact Person: Mr. Michael Field
Tel: +44-701-113-0283

My jet lag must be a little worse than I thought, because I don’t even remember playing! Maybe they read the blog and entered me when I crossed over into British airspace? I feel bad for all the poor folks that have lived here their whole life, patiently waiting for their jackpot. But that’s not gonna keep me from contacting their “fudiciary agent.” Let’s see, they need my bank account number to deposit the winnings. Well, that clearly makes sense. And I have to fill out a form with a lot of info, I guess so that they can prove the payout is going to the right person. I’d better go and fill out this form before they change their mind. Ha, Madonna moved here *years* ago and she never won the National Lottery. Take that, Madonna! 🙂