Comments on: Handling noindex meta tags http://www.mattcutts.com/blog/handling-noindex-meta-tags/ neat fun stuff Wed, 08 Feb 2012 21:30:01 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Lucien den Arendhttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-843562 Lucien den Arend Sat, 16 Jul 2011 09:26:35 +0000 http://www.mattcutts.com/blog/?p=380#comment-843562 Matt, Where do you say something on the meta tag 'classification'? Lucien Matt,
Where do you say something on the meta tag ‘classification’?
Lucien

]]> By: Carpet Londonhttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-756613 Carpet London Thu, 31 Mar 2011 15:10:52 +0000 http://www.mattcutts.com/blog/?p=380#comment-756613 Can anybody please explain me the meaning of "noindex, nofollow" in meta tags? Can anybody please explain me the meaning of “noindex, nofollow” in meta tags?

]]> By: Vincenthttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-577963 Vincent Fri, 18 Jun 2010 12:36:47 +0000 http://www.mattcutts.com/blog/?p=380#comment-577963 Hello Matt if I add the code disallow:pagename in the robots.txt then search engine also not index that page is this right?Regards Laxmi Narayan Hello Matt
if I add the code disallow:pagename in the robots.txt then search engine also not index that page is this right?

Regards
Laxmi Narayan

]]> By: Damuhttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-534748 Damu Fri, 23 Apr 2010 04:33:56 +0000 http://www.mattcutts.com/blog/?p=380#comment-534748 I am now clear on noindex but still not in nofollow. I have a blog and i don't want search engines to find some pages. Those pages have all been indexed, now i want to add <b>noindex, nofollow</b>. Is this nofollow effective on that page only or all the links on the page. I did some search and found few blogs who says it affects all the links on that page as well.Good explaination on nofollow would be gr8.Thanks. I am now clear on noindex but still not in nofollow. I have a blog and i don’t want search engines to find some pages. Those pages have all been indexed, now i want to add noindex, nofollow. Is this nofollow effective on that page only or all the links on the page. I did some search and found few blogs who says it affects all the links on that page as well.

Good explaination on nofollow would be gr8.

Thanks.

]]> By: Dmitry Makarovhttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-442094 Dmitry Makarov Mon, 21 Dec 2009 18:10:55 +0000 http://www.mattcutts.com/blog/?p=380#comment-442094 Want to publish my email on the webpage, clients complain they cant contact me, but will think twice now before I do that... Want to publish my email on the webpage, clients complain they cant contact me, but will think twice now before I do that…

]]> By: Timhttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-426204 Tim Wed, 25 Nov 2009 09:15:23 +0000 http://www.mattcutts.com/blog/?p=380#comment-426204 Hi Matt,I run a Web site that was recently blocked from Google's index without explanation. It's a noncommercial site run as a hobby (i.e. there are no ads, commerce, 'SEO' type activities or motivation for them), so I was/am quite at a loss to find out why.After some non-fruitful tests and attempts to find/guess at the source of the problem (and changing my search pages to Bing.com in protest ;-), a message appeared in Webmaster Tools claiming to have found hidden spammy text as justification for the (or new?) blocking, suggesting the site has been compromised. "The following is some example hidden text we found at http://cexx.org/: order viagra discount... (list of similar naughty words here)"A thorough grep of the server found the page it is most likely triggering on: as part of the anti-malware research we publish on the site, one file lists all the URLs and search keywords a particular ad-popping malware product triggers on. The page is intentional and legitimate (not compromised), however, you can guess the types of keywords this pest triggers on (viagra, mortgage...), and on review, I can fully understand how a bot would classify it as spam. In any case, it's legitimate data, but I'll agree that it has no place being indexed in any search engine. If I read the above correctly, adding the NOINDEX meta tag should at least keep this from appearing in Google and a few other engines.My question is - although NOINDEX'd pages are not shown in the index at all, is the page content still read/parsed by Google for other purposes internally (e.g. the autobanhammer), or does Google essentially abort the HTTP transfer upon encountering the noindex tag? More to the point, is noindex an appropriate way to exclude content from the index that the Algorithm would (either rightly or questionably) use for site classification or assess penalties for?PS. If you are still maintaining this page, the answer to this question would be helpful incorporated into the discussion above on how Google handles pages with noindex tags. I'm sure I'm not the first/only person to wonder about this!Thanks Tim Hi Matt,

I run a Web site that was recently blocked from Google’s index without explanation. It’s a noncommercial site run as a hobby (i.e. there are no ads, commerce, ‘SEO’ type activities or motivation for them), so I was/am quite at a loss to find out why.

After some non-fruitful tests and attempts to find/guess at the source of the problem (and changing my search pages to Bing.com in protest ;-) , a message appeared in Webmaster Tools claiming to have found hidden spammy text as justification for the (or new?) blocking, suggesting the site has been compromised. “The following is some example hidden text we found at http://cexx.org/: order viagra discount… (list of similar naughty words here)”

A thorough grep of the server found the page it is most likely triggering on: as part of the anti-malware research we publish on the site, one file lists all the URLs and search keywords a particular ad-popping malware product triggers on. The page is intentional and legitimate (not compromised), however, you can guess the types of keywords this pest triggers on (viagra, mortgage…), and on review, I can fully understand how a bot would classify it as spam. In any case, it’s legitimate data, but I’ll agree that it has no place being indexed in any search engine. If I read the above correctly, adding the NOINDEX meta tag should at least keep this from appearing in Google and a few other engines.

My question is – although NOINDEX’d pages are not shown in the index at all, is the page content still read/parsed by Google for other purposes internally (e.g. the autobanhammer), or does Google essentially abort the HTTP transfer upon encountering the noindex tag? More to the point, is noindex an appropriate way to exclude content from the index that the Algorithm would (either rightly or questionably) use for site classification or assess penalties for?

PS. If you are still maintaining this page, the answer to this question would be helpful incorporated into the discussion above on how Google handles pages with noindex tags. I’m sure I’m not the first/only person to wonder about this!

Thanks
Tim

]]> By: swegillhttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-403432 swegill Wed, 14 Oct 2009 21:26:52 +0000 http://www.mattcutts.com/blog/?p=380#comment-403432 Well, we all know that there are the standards and rules. But for some reason, we don't have the implementation of those rules or I would say respect for those rules.I would also vote for WC3 standards should be followed...cheers!Swegill Well, we all know that there are the standards and rules. But for some reason, we don’t have the implementation of those rules or I would say respect for those rules.

I would also vote for WC3 standards should be followed…

cheers!

Swegill

]]> By: Seohttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-391858 Seo Mon, 14 Sep 2009 13:11:17 +0000 http://www.mattcutts.com/blog/?p=380#comment-391858 Hi Matt, Nice article but i have some query regarding this (1) Why Google show only very few back links ( for a website ) as compare to Yahoo even Google don't show follow links most of time and Can you please resolve my this query that how a web page with zero or very few back links have good PR ( 3-6 ) OR rank well on SERP as comparisons to other web pages having good back links ( no spam ) . Please reply to me i am waiting for your reply and thanks for sharing your knowledge with us . Hi Matt, Nice article but i have some query regarding this (1) Why Google show only very few back links ( for a website ) as compare to Yahoo even Google don’t show follow links most of time and Can you please resolve my this query that how a web page with zero or very few back links have good PR ( 3-6 ) OR rank well on SERP as comparisons to other web pages having good back links ( no spam ) . Please reply to me i am waiting for your reply and thanks for sharing your knowledge with us .

]]> By: Web Design Bangladeshhttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-363907 Web Design Bangladesh Tue, 21 Jul 2009 06:34:53 +0000 http://www.mattcutts.com/blog/?p=380#comment-363907 From your post it seems to me that noindex meta tag has a great effect on search engine. So, it is possible to block my site to show on search result. Thanks for your nice information to share. From your post it seems to me that noindex meta tag has a great effect on search engine. So, it is possible to block my site to show on search result. Thanks for your nice information to share.

]]> By: James Blunthttp://www.mattcutts.com/blog/handling-noindex-meta-tags/#comment-346666 James Blunt Mon, 15 Jun 2009 04:11:16 +0000 http://www.mattcutts.com/blog/?p=380#comment-346666 I put noindex tag ACCIDENTALLY on large amount of my website, and Google de-indexed it :(Now what can I do to get my pages re-indexed as quickly as possible? I put noindex tag ACCIDENTALLY on large amount of my website, and Google de-indexed it :(

Now what can I do to get my pages re-indexed as quickly as possible?

]]>