GoFuckYourself.com - Adult Webmaster Forum - View Single Post

Tent Pitcher · 12-07-2012, 11:49 PM

You could definitely do what AndrewX says above, but can I ask why you want to avoid the two most logical ways to limit crawl frequency? Do you not have the necessary privileges to access robots.txt or Webmaster Tools?

12-07-2012, 11:49 PM
Tent Pitcher Confirmed User Industry Role: Join Date: Nov 2012 Location: New Orleans Posts: 213	You could definitely do what AndrewX says above, but can I ask why you want to avoid the two most logical ways to limit crawl frequency? Do you not have the necessary privileges to access robots.txt or Webmaster Tools? __________________ Tent Pitcher - Adult Search Engine