Thread: does Crawl-Delay affect seo for robots.txt
View Single Post
Old 12-05-2011, 01:49 AM  
AllAboutCams
Femcams.com
 
AllAboutCams's Avatar
 
Industry Role:
Join Date: Jul 2011
Location: bjcam.com
Posts: 12,220
Quote:
Originally Posted by anexsia View Post
I'm curious...what would be the benefit of setting a crawl-delay?
apparently that is why my hosting keeps crashing
AllAboutCams is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote