|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
09-01-2005, 04:33 PM
|
#1 |
|
Confirmed User
Industry Role:
Join Date: May 2002
Location: Toronto
Posts: 8,478
|
Lots of unwanted pages in site:adultsitesurfer.com in google/yahoo, help!
Hey, having some problems with pages appearing in both google and yahoo that we don't need indexed. We've tried to use robots.txt but it doesn't seem to be working.
http://www.adultsitesurfer.com/robots.txt The unwanted links are like http://www.adultsitesurfer.com/comme...p?site_id=1306 and http://www.adultsitesurfer.com/email...hp?site_id=410 Yahoo page of bad links Not sure what to do? Any help appreciated! |
|
|
|
09-01-2005, 04:42 PM
|
#2 |
|
WINNING!
Industry Role:
Join Date: Oct 2002
Posts: 14,579
|
|
|
|
|
|
09-01-2005, 04:42 PM
|
#3 |
|
PornSiteDomains.com
Industry Role:
Join Date: Oct 2002
Location: US
Posts: 1,265
|
stick those two files (comment and email review) in a sub directory and then add the subdirectory to your robots file. I think they will eventually be removed if you do that but if you don't want to wait at Google you can remove them at:
http://services.google.com/urlconsole/controller |
|
|
|
|
09-01-2005, 04:42 PM
|
#4 |
|
WINNING!
Industry Role:
Join Date: Oct 2002
Posts: 14,579
|
<meta name="robots" content="noindex,nofollow">
put that in the header, and you are 95% sure it wont index it |
|
|
|
|
09-01-2005, 04:44 PM
|
#5 |
|
Confirmed User
Join Date: Apr 2004
Location: Very close to that Jack Daniels bottle..
Posts: 6,341
|
robots.txt would do all the trick.
|
|
|
|
