36 different robots | Hits | Bandwidth | Last visit |
MSNBot | 4812+124 | 9.55 GB | 31 Jan 2006 - 22:29 |
Unknown robot (identified by 'crawl') | 4044+585 | 32.05 MB | 31 Jan 2006 - 23:47 |
Googlebot | 2474+73 | 6.13 GB | 31 Jan 2006 - 23:12 |
Java (Often spam bot) | 1239 | 9.15 MB | 29 Jan 2006 - 08:07 |
Ask | 1075+38 | 8.63 MB | 31 Jan 2006 - 23:31 |
Python-urllib | 847 | 6.86 MB | 30 Jan 2006 - 14:42 |
ConveraCrawler | 682+4 | 1.90 GB | 28 Jan 2006 - 20:49 |
LinkChecker | 246+1 | 1.94 MB | 02 Jan 2006 - 22:46 |
Harvest | 72 | 275.66 KB | 31 Jan 2006 - 15:36 |
psbot | 64+2 | 956.76 KB | 28 Jan 2006 - 13:19 |
Yahoo Slurp | 32+27 | 8.89 MB | 30 Jan 2006 - 11:14 |
Findlinks | 13+14 | 78.39 KB | 31 Jan 2006 - 08:36 |
Unknown robot (identified by empty user agent string) | 11+11 | 11.23 KB | 30 Jan 2006 - 01:22 |
BaiDuSpider | 6+2 | 31.04 KB | 25 Jan 2006 - 02:48 |
Unknown robot (identified by hit on 'robots.txt') | 0+7 | 616 Bytes | 29 Jan 2006 - 08:41 |
Unknown robot (identified by 'discovery') | 6 | 0 | 17 Jan 2006 - 06:22 |
ZyBorg | 4+1 | 14.58 KB | 31 Jan 2006 - 20:54 |
Turn It In | 4+1 | 14.43 KB | 07 Jan 2006 - 02:23 |
miniRank | 3+2 | 14.89 KB | 04 Jan 2006 - 12:17 |
Perl tool | 2+1 | 11.09 KB | 10 Jan 2006 - 18:19 |
nicebot | 3 | 23.97 KB | 27 Jan 2006 - 22:20 |
boitho.com-dc | 1+1 | 5.23 KB | 29 Jan 2006 - 03:53 |
BecomeBot | 1+1 | 5.23 KB | 20 Jan 2006 - 23:57 |
Alexa (IA Archiver) | 1+1 | 5.23 KB | 05 Jan 2006 - 17:11 |
aipbot | 1+1 | 5.23 KB | 20 Jan 2006 - 13:51 |
Voyager | 1+1 | 5.23 KB | 25 Jan 2006 - 18:28 |
HTTrack off-line browser | 1+1 | 5.23 KB | 09 Jan 2006 - 04:02 |
GigaBot | 1+1 | 5.23 KB | 08 Jan 2006 - 16:11 |
Cfetch | 1 | 0 | 17 Jan 2006 - 03:40 |
WGet tools | 1 | 0 | 05 Jan 2006 - 01:24 |
zspider | 1 | 5.14 KB | 10 Jan 2006 - 18:49 |
IRLbot | 0+1 | 88 Bytes | 26 Jan 2006 - 22:38 |
MSIECrawler | 0+1 | 88 Bytes | 28 Jan 2006 - 00:31 |
Others | 0 | 46 Bytes | |
|