if you are concerned about server stress from search engine bots you have bigger issues than the ones you may be contemplating.
Quote:
Originally Posted by rowan
LOL. Even though the SE bots are actually the majority of the "traffic" loading the site this issue is nothing to do with bandwidth. It is more multiple database accesses and overall load of the server.
|