Comments on: Search results in search results http://www.mattcutts.com/blog/search-results-in-search-results/ neat fun stuff Fri, 06 Nov 2009 18:35:07 -0800 http://wordpress.org/?v=2.8.5 hourly 1 By: Stefanos http://www.mattcutts.com/blog/search-results-in-search-results/#comment-378565 Stefanos Wed, 19 Aug 2009 20:08:03 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-378565 Robots.txt files are very useful for the following reasons too: Saving Bandwidth: Search engine spider robots and web robots visit often our web sites to index changes in our content. We can restrict access to certain directories that we do not want crawlers to access. Cleans Up Your Logs: After submitting your web site to the search engines than the spider robots will be searching for your robots.txt file. Every time a robot searches for this file and it does not find one, it generates a ‘404 File Not Found’ error. Adding the file to your root directory will help eliminate these errors and boost your rankings. Online Protection: The search engine robots, unless instructed otherwise by your robots.txt file, will attempt to index as much of your web site as possible. This means that they will also access file on the serves that they should not have access to. Avoid Unwanted Indexing: If a part of you web site is still being developed than you might want to prevent crawlers from indexing your content. Robots.txt files are very useful for the following reasons too:

Saving Bandwidth: Search engine spider robots and web robots visit often our web sites to index changes in our content. We can restrict access to certain directories that we do not want crawlers to access.

Cleans Up Your Logs: After submitting your web site to the search engines than the spider robots will be searching for your robots.txt file. Every time a robot searches for this file and it does not find one, it generates a ‘404 File Not Found’ error. Adding the file to your root directory will help eliminate these errors and boost your rankings.

Online Protection: The search engine robots, unless instructed otherwise by your robots.txt file, will attempt to index as much of your web site as possible. This means that they will also access file on the serves that they should not have access to.

Avoid Unwanted Indexing: If a part of you web site is still being developed than you might want to prevent crawlers from indexing your content.

]]> By: mevans05 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-334086 mevans05 Fri, 22 May 2009 19:04:44 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-334086 I completely agree with Jeremy CEO @ Yelp. If a site's search results page has valuable, unique (i.e. not scraped from other sites) content that satisfies a searcher's intent, then why would it be considered unworthy for Google search results?! I completely agree with Jeremy CEO @ Yelp. If a site’s search results page has valuable, unique (i.e. not scraped from other sites) content that satisfies a searcher’s intent, then why would it be considered unworthy for Google search results?!

]]> By: Sarah http://www.mattcutts.com/blog/search-results-in-search-results/#comment-184884 Sarah Wed, 10 Dec 2008 13:17:17 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-184884 I found this page looking for info on "cooks.com search spam". Is Google finally going to do something about this website? Every single time I search for a recipe online, I hit this spammy Cooks.com website. Half the time the site isn't active, and when I can actually access a page, it's scraped search results. I found this page looking for info on “cooks.com search spam”. Is Google finally going to do something about this website? Every single time I search for a recipe online, I hit this spammy Cooks.com website. Half the time the site isn’t active, and when I can actually access a page, it’s scraped search results.

]]> By: Dipali http://www.mattcutts.com/blog/search-results-in-search-results/#comment-123680 Dipali Fri, 07 Mar 2008 09:16:16 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-123680 Hello Matt, i have query regarding Google Debuts "Search Within A Site" Search Box Feature. my site has good back link and page rank. but when i am searching regarding my site but i cuodunt find this type of feature for my site? can u tell me whats the criteria for search within A site search box? Regards, Dipali Hello Matt,

i have query regarding Google Debuts “Search Within A Site” Search Box Feature. my site has good back link and page rank. but when i am searching regarding my site but i cuodunt find this type of feature for my site?

can u tell me whats the criteria for search within A site search box?

Regards,
Dipali

]]> By: m1t0s1s http://www.mattcutts.com/blog/search-results-in-search-results/#comment-118417 m1t0s1s Sun, 09 Dec 2007 20:41:48 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-118417 Cooks.com is still spamming search results with search results. Just google for <em>rosemary potatoes</em>. Don't worry, you're still ranking well for bacon polenta ;-) Cooks.com is still spamming search results with search results. Just google for rosemary potatoes. Don’t worry, you’re still ranking well for bacon polenta ;-)

]]> By: Bien http://www.mattcutts.com/blog/search-results-in-search-results/#comment-113355 Bien Mon, 24 Sep 2007 03:18:19 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-113355 Thanks for the tip. I'll start blocking search results in my ZenCart shops using robots.txt. I hope the default setup of popular open source packages start doing the same. Thanks for the tip. I’ll start blocking search results in my ZenCart shops using robots.txt. I hope the default setup of popular open source packages start doing the same.

]]> By: m1t0s1s http://www.mattcutts.com/blog/search-results-in-search-results/#comment-112162 m1t0s1s Wed, 05 Sep 2007 04:05:18 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-112162 Ever googled for black bean dip recipe? cooks.The first result, from cooks.com, is an internal search result. So give us a reason why every site shouldn't do such a thing, have a "RECENT SEARCHES" widget on every damn page? Ever googled for black bean dip recipe? cooks.The first result, from cooks.com, is an internal search result. So give us a reason why every site shouldn’t do such a thing, have a “RECENT SEARCHES” widget on every damn page?

]]> By: Ricky Thomas http://www.mattcutts.com/blog/search-results-in-search-results/#comment-110949 Ricky Thomas Mon, 13 Aug 2007 20:05:37 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-110949 Hi, I think this makes sense for our site. I've just added a disallow for anything with the word search in so will see if it makes our site cleaner looking. Hi,

I think this makes sense for our site. I’ve just added a disallow for anything with the word search in so will see if it makes our site cleaner looking.

]]> By: I like coffee http://www.mattcutts.com/blog/search-results-in-search-results/#comment-106357 I like coffee Tue, 12 Jun 2007 01:46:36 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-106357 I have a solution for all those who want to keep the indexing in and those who want it out and a way Google can make one more additional revenue stream....you all know where I am going with this right? Yes, charge a dollar amount for your site index to be available in the search results. This does many things at once, first of all, gets rid of all the people who are just toying with the system and not producing anything but leaching. Second, it provides legitimacy for the companies who are allowed to have their results show up. Third user search is less crowded with useless garbage no one really can use. Last, Google has one more revenue stream. Yes Google, I want 1% of revs for this idea! Thanks. I have a solution for all those who want to keep the indexing in and those who want it out and a way Google can make one more additional revenue stream….you all know where I am going with this right?

Yes, charge a dollar amount for your site index to be available in the search results. This does many things at once, first of all, gets rid of all the people who are just toying with the system and not producing anything but leaching. Second, it provides legitimacy for the companies who are allowed to have their results show up. Third user search is less crowded with useless garbage no one really can use. Last, Google has one more revenue stream.

Yes Google, I want 1% of revs for this idea! Thanks.

]]> By: Bambarbia Kirkudu http://www.mattcutts.com/blog/search-results-in-search-results/#comment-105015 Bambarbia Kirkudu Thu, 24 May 2007 21:15:52 +0000 http://www.mattcutts.com/blog/search-results-in-search-results/#comment-105015 "copies of websites via proxies" - nice words ;) “copies of websites via proxies” – nice words ;)

]]>