Quote:
Originally Posted by The Hun
I know the blame for this could be put in the fact that my bot has no point nosing around on people's galleries, but it doesn't need to be added to the whitelist, there shouldn't be a whitelist on a free gallery to begin with...
|
I know for myself, I block any bot that serves me no purpose -- at the firewall/router. For example, non-SE Spider bots, **anything** from China, several ranges from ColoCrossing. They are useless to me and/or problematic (spamming, malware attacks, etc).
In any case, one thing people can do with CloudFlare who have an issue with your bot is to do the following:
1. Disable Browser Integrity Check
2. If their galleries are in a subfolder or subdomain, they can add a specific rule to exclude that subfolder/subdomain in their WAF settings (Web Application Firewall).