Thread: Does anyone even bother with robots.txt anymore?
View Single Post
Old 01-24-2013, 07:26 AM  
Rockhound
Confirmed User
 
Industry Role:
Join Date: Jan 2003
Posts: 334
I use it because Google wants me to, but while we're on the subject... What do you guys put in your robots.txt files that make them better?
Rockhound is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote