Quote:
Originally Posted by WiredGuy
You can send outgoing traffic to domain.com/out/ and then disallow Googlebot access to that path via a robots.txt file.
WG
|
You cannot actually "disallow" Googlebot from any path. It can, and does follow ALL links it finds, regardless of robots.txt settings.
My experience has shown this to be the case, for years.