Robots.txt help. How do I do this?
 

I want to disallow the folder /sub/, but I want to allow everything in that folder. e.g. /sub/page1, /sub/page2

Any quick way to allow all files/folders inside /sub/ but disallow /sub/ alone?

yeah but cant remember, damn pain meds.

but not all spiders follow those rules.

Umm I think it is
User-Agent: *
Disallow: /dirofyourdesire/

I take no responsibility if you loose all rankings, i am under the influence.

That will disallow all the dirs under it too.

Hope you feel better soon, man.

Why dont you remove the index.html /.php from /sub/
and add a .htaccess file in /sub/:
Options -Indexes

Thanks, i feel great actually. One of those things about pain meds.

Oh and thats also why i put in warning.

There isn't one. This script uses a lot of mod rewrite. I can't htacces http://site.com/sub/ because it doesn't actually exist. apparently I can't redirect it either. My only option is to disallow it.

Disallow /sub
Allow /sub/

-edit...but to play it safe, just name all the folders to allow

Allow /sub/folder1
etc

Yeah, I use there tool to test it. I ended up just allowing /sub/a-z* and disallowing /sub/

Thanks