Robots.txt question
 

Guys,

Quick question about robots.txt
If this following is my robots.txt I can assume that google wont index /feed /trackback etc right ?

I have placed robots.txt in my root directory and for some reason he is still indexing these pages e.g. www.teensqueezer.com/feed/ can be found on google. HOW ?

User-agent: Googlebot
Disallow: /*/feed/$
Disallow: /*/feed/rss/$
Disallow: /*/trackback/$
User-agent: *
Disallow: /wp-
Disallow: /feed/
Disallow: /trackback/
Disallow: /rss/
Disallow: /comments/feed/
Disallow: /page/
Disallow: /date/
Disallow: /comments/
Disallow: /linkex/

you realize you may have to wait a while before the spider reads this new txt file right?

I did not know that! i thought the very first time the spider would come along, it would read the list....maybe I've got to have some more patience.

thnx

Yeah give it a little while, remember anytime you're dealing with SE or spiders, it's about patience, might take a while, esp if the site is newer.

Interesting!