Thread: does Crawl-Delay affect seo for robots.txt
View Single Post
Old 12-05-2011, 01:46 AM  
anexsia
Confirmed User
 
anexsia's Avatar
 
Industry Role:
Join Date: May 2010
Posts: 5,735
I'm curious...what would be the benefit of setting a crawl-delay?
anexsia is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote