47 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 19924+835 | 17.15 GB | 31 Oct 2008 - 23:58 |
Unknown robot (identified by hit on 'robots.txt') | 0+1167 | 88.00 KB | 31 Oct 2008 - 23:57 |
MSNBot | 8966+597 | 9.00 GB | 31 Oct 2008 - 23:53 |
Yahoo Slurp | 13824+455 | 14.00 GB | 31 Oct 2008 - 23:52 |
Unknown robot (identified by empty user agent string) | 160+16 | 66.51 MB | 31 Oct 2008 - 23:51 |
Ask | 346+43 | 34.87 MB | 31 Oct 2008 - 23:45 |
Googlebot | 8487+29 | 18.31 GB | 31 Oct 2008 - 23:40 |
Bloglines | 576 | 2.86 MB | 31 Oct 2008 - 23:13 |
MSNBot-media | 631+78 | 1.07 GB | 31 Oct 2008 - 22:52 |
twiceler | 0+23 | 1.98 KB | 31 Oct 2008 - 16:43 |
Unknown robot (identified by 'bot*') | 395+93 | 393.35 MB | 31 Oct 2008 - 13:34 |
Nutch | 15+17 | 10.01 MB | 31 Oct 2008 - 12:32 |
Alexa (IA Archiver) | 2+2 | 105.96 KB | 31 Oct 2008 - 12:16 |
Jakarta commons-httpclient | 41+1 | 21.59 MB | 31 Oct 2008 - 11:55 |
BaiDuSpider | 183+7 | 2.12 MB | 31 Oct 2008 - 09:06 |
MSIECrawler | 15+46 | 71.82 KB | 31 Oct 2008 - 04:17 |
archive.org bot | 8+6 | 12.63 MB | 31 Oct 2008 - 02:49 |
Speedy Spider | 20+10 | 10.32 MB | 30 Oct 2008 - 16:04 |
Voila | 28+18 | 5.87 MB | 30 Oct 2008 - 10:48 |
ichiro | 2+1 | 87.43 KB | 30 Oct 2008 - 06:44 |
BBot | 4 | 13.45 MB | 30 Oct 2008 - 00:33 |
Java (Often spam bot) | 1261+2 | 6.90 MB | 30 Oct 2008 - 00:33 |
EasyDL | 1 | 28.37 KB | 29 Oct 2008 - 08:18 |
Harvest | 65 | 5.00 MB | 28 Oct 2008 - 16:36 |
Yandex bot | 2+2 | 10.46 KB | 28 Oct 2008 - 13:02 |
WGet tools | 3+1 | 2.44 MB | 28 Oct 2008 - 05:41 |
Unknown robot (identified by 'robot') | 22+14 | 7.92 MB | 28 Oct 2008 - 01:42 |
GigaBot | 736+41 | 1.68 GB | 27 Oct 2008 - 14:18 |
Heritrix | 7+6 | 5.23 MB | 25 Oct 2008 - 06:11 |
Exabot | 34+11 | 201.04 KB | 25 Oct 2008 - 01:23 |
Perl tool | 5 | 942.28 KB | 24 Oct 2008 - 15:19 |
The web archive (IA Archiver) | 0+2 | 176 Bytes | 24 Oct 2008 - 09:56 |
BSpider | 0+4 | 352 Bytes | 24 Oct 2008 - 07:30 |
yacy | 3+1 | 21.30 KB | 24 Oct 2008 - 02:00 |
FaceBook bot | 2 | 2.43 MB | 23 Oct 2008 - 22:26 |
Sogou Spider | 4 | 0 | 23 Oct 2008 - 22:14 |
BecomeBot | 2+4 | 99.38 KB | 22 Oct 2008 - 08:20 |
MSRBOT | 23+9 | 2.09 MB | 21 Oct 2008 - 22:46 |
Gaisbot | 634+11 | 5.66 MB | 20 Oct 2008 - 00:25 |
Unknown robot (identified by 'discovery') | 126+1 | 1.37 MB | 17 Oct 2008 - 01:41 |
Susie | 14 | 73.00 KB | 15 Oct 2008 - 18:29 |
MJ12bot | 1+1 | 5.23 KB | 12 Oct 2008 - 07:51 |
CFNetwork | 2 | 2.43 MB | 10 Oct 2008 - 12:06 |
Grub.org | 2+2 | 1.30 MB | 04 Oct 2008 - 08:40 |
lwp-request | 1 | 0 | 03 Oct 2008 - 23:29 |
HTTrack off-line browser | 0+1 | 88 Bytes | 03 Oct 2008 - 04:43 |
lwp-trivial | 1 | 2.69 KB | 01 Oct 2008 - 13:05 |