|
robots.txt is looked for first, and followed - so it won't bother hitting the metas if you no-index the site.
Yahoo! will take forever to index and list you if you don't have a robots.txt, for example, even if you have a robots meta tag.
__________________
YOU Are Industry News!
Press Releases: pr[at]payoutmag.com
Facebook: Payout Magazine! Facebook: MIKEB!
ICQ: 248843947
Skype: Mediaguy1
|