GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   google question (https://gfy.com/showthread.php?t=162307)

lil2rich4u2 08-10-2003 11:58 AM

google question
 
although it doesnt index password protected pages, does it even spider them?

is the content counted? or google cant get in either?

cash69 08-10-2003 12:02 PM

don't think so.. when i browse google i've never hit a pw protected page before..

Fabuleux 08-10-2003 12:02 PM

If it is protected with .htaccess google can't spider it.

completetosser 08-10-2003 12:05 PM

Just disallow any pages you don't want spidering in your robots.txt


All times are GMT -7. The time now is 02:25 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123