Quote:
Originally Posted by hdbuilder
Just put this in your htaccess file in the root of each domain:
# Block bad spiders
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Sosospider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Baiduspider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Sogou
RewriteRule ^.* - [F,L]
You can add as many as you want , make sure the lines ends with [NC,OR] and with nothing for the last one
Using it for years and been tested ...
|
Thanks - That looks like it will do the trick...
The main reason is that it inflates my traffic to sponsors so much its hard to see what the real conversions are - If you are as into stats as me it is a real pain in the ass...
I am moving towards using GeoIp scripts and sorting traffic that way but it takes time.....