Quote:
Originally Posted by Basic_man
Why not setup it in the webmasters area from Google directly...?? It's free and a valid solid solution...  |
I don't like Google knowing too much about my sites.
By removing support for robots.txt crawl-delay (they used to support it) they're forcing people to use their proprietary webmaster tools system.