Thread: does Crawl-Delay affect seo for robots.txt
View Single Post
Old 12-05-2011, 01:43 AM  
AllAboutCams
Femcams.com
 
AllAboutCams's Avatar
 
Industry Role:
Join Date: Jul 2011
Location: bjcam.com
Posts: 12,220
does Crawl-Delay affect seo for robots.txt
does Crawl-Delay affect seo
i.e. if i set my Crawl-Delay for robots.txt
5 seconds
10 seconds
20 seconds
60 seconds
120 seconds
AllAboutCams is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote