View Single Post
Old 12-09-2012, 09:19 PM  
cruxop
Registered User
 
Industry Role:
Join Date: Aug 2007
Location: USA
Posts: 61
What its called is 'Rate limiting by IP'.

If you're using Nginx, its provided by the HttpLimmitReqModule. More info here: http://serverfault.com/questions/179...-prevent-abuse

Basically it lets you make a setting that says no more than X request per second per IP.

If you're using Apache, the module you'd use is called "mod_evasive".

If you're using Lighttpd, the module you'd use is called ModEvasive.

------

Using any of those modules may help with your problem, as well as stop people from spidering and ripping your sites quickly. The issue with Google is that if they use many IP addresses, they may get around your rate-limit.
cruxop is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook