GoFuckYourself.com - Adult Webmaster Forum - View Single Post

Eriic · 10-23-2008, 08:58 AM

How could it hurt?
when the robots gather info. from your robots.txt and if it is allowed to follow all links, then that is just more information gathered about your sites.

10-23-2008, 08:58 AM
Eriic So Fucking Banned Join Date: Jan 2008 Posts: 2,995	How could it hurt? when the robots gather info. from your robots.txt and if it is allowed to follow all links, then that is just more information gathered about your sites.