Robots meta tags... little help please - GoFuckYourself.com

iwantchixx · 06-22-2005, 07:38 AM

What would I use to tell the search engines to NOT read a specific page and it NOT affect the rest of the site. I just want one page to be ignored.

Code_Havoc · 06-22-2005, 07:46 AM

Do a search on google for 'Robot Exclusion Standard'

You'll have to make a robots.txt file and put it on your root www folder (so you can access it from the browser: http://www.cnn.com/robots.txt). In that file you'll tell the world what browsers can and cant go to certain parts of your site.

Serge Litehead · 06-22-2005, 07:56 AM

robots.txt:
User-agent: *
Disallow: /specific_dir/
Disallow: /particular_file.html

in file:
<META NAME="robots" CONTENT="noindex">

more robots.txt info

additionally you can have nofollow command for a specific link, introduced by google
<a href="http://www.site.com/page.html" rel="nofollow">Visit My Page</a>

iwantchixx · 06-22-2005, 08:33 AM

thanks guys

06-22-2005, 07:38 AM	#1
iwantchixx Too lazy to set a custom title Industry Role: Join Date: Oct 2002 Location: The Boonies Posts: 12,860	Robots meta tags... little help please What would I use to tell the search engines to NOT read a specific page and it NOT affect the rest of the site. I just want one page to be ignored.

06-22-2005, 07:56 AM	#3
Serge Litehead Confirmed User Industry Role: Join Date: Dec 2002 Location: Behind the scenes Posts: 5,190	robots.txt: User-agent: * Disallow: /specific_dir/ Disallow: /particular_file.html in file: <META NAME="robots" CONTENT="noindex"> more robots.txt info additionally you can have nofollow command for a specific link, introduced by google <a href="http://www.site.com/page.html" rel="nofollow">Visit My Page</a> __________________ SilverCrocodile.com Adult web design since '05

06-22-2005, 07:46 AM	#2
Code_Havoc Registered User Join Date: Jun 2005 Posts: 221	Do a search on google for 'Robot Exclusion Standard' You'll have to make a robots.txt file and put it on your root www folder (so you can access it from the browser: http://www.cnn.com/robots.txt). In that file you'll tell the world what browsers can and cant go to certain parts of your site.

06-22-2005, 08:33 AM	#4
iwantchixx Too lazy to set a custom title Industry Role: Join Date: Oct 2002 Location: The Boonies Posts: 12,860	thanks guys