if they're not smart enough to check the reverse ip of a search bot, then they deserve to get ripped off. they have shitloads of overpaid engineers too.
i only allow authenticated search engine bots on our network. the rest of the bots, spiders, pirates, etc can fuck off. none of our sites need to be indexed in Zanzabar. most spiders are just making lists for pirates.
#
__________________
#
|