Quote:
Originally Posted by digitalfantasies
Disallow prevents a page content from being crawled, it doesn't mean a site or page won't be indexed, like the no index tag does.
So with enough backlinks and usually a matching keyword in the domain, whitelabels can still rank.
Though it's a lot rarer than it was before penguin & panda. And usually short lived
|
Google respects robots.txt rules. If the bot does not crawl the site - it is impossible to get indexed.