|
These are this months bots:
Googlebot
Yahoo Slurp
Unknown robot (identified by 'crawl')
EchO!
MSNBot
BBot
Unknown robot (identified by hit on 'robots.txt')
Alexa (IA Archiver)
MSIECrawler
Unknown robot (identified by 'bot/' or 'bot-')
larbin
Nutch
Unknown robot (identified by 'spider')
SurveyBot
BaiDuSpider
Girafabot
The web archive (IA Archiver)
Google AdSense
OutfoxBot
ZyBorg
Ingrid
SBIder
Voyager
Unknown robot (identified by 'robot')
GigaBot
AskJeeves
Y!J Yahoo Japan
bender focused_crawler
__________________
|