Thanks for the quick reply but you didn't understand my question. I want every folder and page to be indexed except for any file that has the word page in it.
So for example I don't want the following indexed:
domain.com/page1.php
domain.com/page2.php
domain.com/folder/page1.php
domain.com/folder/page2.php
I read somewhere that Disallow: */page- should do that but I am not sure.
|