45 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 11030+613 | 4.91 GB | 30 Nov 2006 - 23:28 |
Yahoo Slurp | 2288+712 | 3.18 GB | 30 Nov 2006 - 23:36 |
Unknown robot (identified by 'bot*') | 1915+19 | 349.95 MB | 30 Nov 2006 - 02:12 |
Ask | 1341+56 | 126.60 MB | 30 Nov 2006 - 23:52 |
Googlebot | 1090+29 | 723.55 MB | 30 Nov 2006 - 23:24 |
Java (Often spam bot) | 624+1 | 3.43 MB | 30 Nov 2006 - 19:18 |
LinkChecker | 493+2 | 3.88 MB | 28 Nov 2006 - 02:44 |
ConveraCrawler | 481+2 | 870.14 MB | 28 Nov 2006 - 16:09 |
MSNBot-media | 454+21 | 3.54 MB | 28 Nov 2006 - 11:12 |
MSNBot | 98+67 | 17.07 MB | 30 Nov 2006 - 06:25 |
Voyager | 101+18 | 763.01 KB | 30 Nov 2006 - 17:17 |
Unknown robot (identified by hit on 'robots.txt') | 0+88 | 7.56 KB | 30 Nov 2006 - 20:14 |
NutchCVS | 76+4 | 1.27 MB | 14 Nov 2006 - 00:41 |
Unknown robot (identified by empty user agent string) | 66+10 | 54.73 MB | 29 Nov 2006 - 21:53 |
Exabot | 45+14 | 298.00 KB | 29 Nov 2006 - 07:06 |
Findlinks | 17+16 | 248.05 KB | 30 Nov 2006 - 08:46 |
Sina Iask Spider | 31 | 159.48 KB | 30 Nov 2006 - 15:08 |
Harvest | 30 | 1.67 MB | 28 Nov 2006 - 15:36 |
ZyBorg | 21+2 | 325.91 KB | 29 Nov 2006 - 14:39 |
Unknown robot (identified by 'robot') | 10+10 | 28.75 KB | 30 Nov 2006 - 03:50 |
Heritrix | 11+4 | 48.91 MB | 28 Nov 2006 - 23:37 |
Jakarta commons-httpclient | 11+2 | 16.14 MB | 30 Nov 2006 - 23:31 |
Sogou Spider | 7+4 | 1.16 MB | 20 Nov 2006 - 09:09 |
WGet tools | 7+2 | 12.09 MB | 29 Nov 2006 - 10:58 |
Nutch | 3+3 | 15.69 KB | 19 Nov 2006 - 11:12 |
Cfetch | 5 | 0 | 28 Nov 2006 - 05:02 |
Custo | 5 | 1.96 MB | 29 Nov 2006 - 16:49 |
CFNetwork | 5 | 10.29 MB | 25 Nov 2006 - 15:55 |
Perl tool | 5 | 39.16 KB | 14 Nov 2006 - 16:56 |
MSIECrawler | 4+1 | 18.86 KB | 14 Nov 2006 - 15:30 |
The web archive (IA Archiver) | 0+4 | 352 Bytes | 21 Nov 2006 - 04:25 |
ichiro | 2+2 | 5.75 KB | 27 Nov 2006 - 22:57 |
ASpider (Associative Spider) | 1+2 | 11.66 KB | 23 Nov 2006 - 00:53 |
BaiDuSpider | 2+1 | 88 Bytes | 27 Nov 2006 - 13:44 |
Netcraft | 3 | 0 | 05 Nov 2006 - 20:43 |
psbot | 1+1 | 88 Bytes | 29 Nov 2006 - 23:55 |
Alexa (IA Archiver) | 1+1 | 1.21 MB | 11 Nov 2006 - 13:29 |
GigaBot | 1+1 | 2.52 KB | 01 Nov 2006 - 18:04 |
BBot | 2 | 210.80 KB | 17 Nov 2006 - 10:02 |
larbin | 1+1 | 5.23 KB | 19 Nov 2006 - 00:16 |
MJ12bot | 1+1 | 4.27 KB | 19 Nov 2006 - 01:35 |
Pompos | 0+1 | 88 Bytes | 09 Nov 2006 - 03:47 |
nicebot | 1 | 7.44 KB | 18 Nov 2006 - 22:38 |
twiceler | 0+1 | 88 Bytes | 30 Nov 2006 - 21:30 |
lwp-trivial | 1 | 2.69 KB | 20 Nov 2006 - 07:17 |