Quote:
Originally Posted by toonpornblog
What's the crawler identify itself as? Most of the 'legit' ones identify themselves in the User Agent.
|
I haven't even looked at any of that. I just noticed the search terms in my traffic script when looking at page hits.