Thread: Does anyone even bother with robots.txt anymore?
View Single Post
Old 01-24-2013, 01:48 AM  
Mr Pheer
Living inside your head.
 
Mr Pheer's Avatar
 
Industry Role:
Join Date: Dec 2002
Location: In your AirBNB
Posts: 20,491
Of course, it's important.
Mr Pheer is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote