Quote:
Originally Posted by rowan
I just thought of a sticky tape and bandaids solution to the crawl-delay issue... since Googlebot appears to fetch sequentially, why not just add a delay yourself?
if (strpos($_SERVER["HTTP_USER_AGENT"], " Googlebot/") > 0) sleep(2);
|
Why not setup it in the webmasters area from Google directly...?? It's free and a valid solid solution...
