Thread: Robots.txt Help
View Single Post
Old 08-28-2011, 04:33 AM  
OzMan84
Confirmed User
 
Join Date: Nov 2003
Location: Australia
Posts: 4,740
Robots.txt Help

Hi,

Not sure if ive set this up incorrect but there are still pages getting indexed
Quote:
User-Agent: *
Disallow: /*page/

User-agent: *
Disallow: /*?
domain.com/455/report.php?id=455
domain.com/316/page/popular_likes/0-20/

are two examples of the type pages that are getting indexed

any tips/suggestions would be great
__________________
XferClick - 300,000 UV daily and growing quickly. Majority US, EU, CA and AU traffic. Contact me for more information
ICQ: 304568058
OzMan84 is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote