Quote:
Originally Posted by signupdamnit
I hope not. The first thing Yahoo will do is get rid of adult or put it behind a wall where it can't be spidered.
|
Tumblr has already done that, by putting all blogs flagged "adult" behind a robots.txt that excludes all the spiders.
http://www.erosblog.com/2013/05/15/n...tumblr-search/
Now, maybe we know
why!