Thread: Tumblr CEO David Karp responds to complaints about NSFW censorship.
View Single Post
Old 07-21-2013, 12:35 PM  
signupdamnit
Confirmed User
 
signupdamnit's Avatar
 
Industry Role:
Join Date: Aug 2007
Posts: 6,697
Quote:
Originally Posted by Itchy View Post
Sitemap: http://********.tumblr.com/sitemap1.xml

User-agent: *
Disallow: /private
Disallow: /random
Disallow: /day
Crawl-delay: 1

is what I see on my robots.txt
That means you (or more accurately bots) aren't being blocked. Was it different for you a week ago?
__________________

You don't like my posts? Put me on ignore or fuck right off. I'll say what I want.
signupdamnit is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote