Thread: Robots.txt
View Single Post
Old 10-27-2008, 10:19 AM  
alexchechs
Confirmed User
 
alexchechs's Avatar
 
Join Date: May 2008
Location: BROOKLYN!!!
Posts: 3,474
They are pretty simple files and can do alot for your site. I also suggest using a .xml site map and have google spider it often
__________________
Alex Chechs
http://thefawnconspiracy.com
alexchechs is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote