GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   robots.txt question (https://gfy.com/showthread.php?t=465043)

X37375787 05-08-2005 10:13 AM

robots.txt question
 
If I have a whole bunch of pages of type domain.com/script.php?id=XXX indexed in SEs, and I would like to block spiders from indexing them, do I use

User-agent: *
Disallow: script.php


in order to block all the pages?
Thanks

Trax 05-08-2005 10:14 AM

yep, correct
disallow: /script.php

don't forget the /

X37375787 05-08-2005 10:22 AM

thanks for the info Trax

Jim Neil 05-08-2005 01:31 PM

Thanks for the info.

This is something that i was wondering too. :thumbsup

Trax 05-08-2005 03:03 PM

youre welcome


All times are GMT -7. The time now is 12:49 AM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123