| 47 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 19924+835 | 17.15 GB | 31 Oct 2008 - 23:58 |
| Yahoo Slurp | 13824+455 | 14.00 GB | 31 Oct 2008 - 23:52 |
| MSNBot | 8966+597 | 9.00 GB | 31 Oct 2008 - 23:53 |
| Googlebot | 8487+29 | 18.31 GB | 31 Oct 2008 - 23:40 |
| Java (Often spam bot) | 1261+2 | 6.90 MB | 30 Oct 2008 - 00:33 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1167 | 88.00 KB | 31 Oct 2008 - 23:57 |
| GigaBot | 736+41 | 1.68 GB | 27 Oct 2008 - 14:18 |
| MSNBot-media | 631+78 | 1.07 GB | 31 Oct 2008 - 22:52 |
| Gaisbot | 634+11 | 5.66 MB | 20 Oct 2008 - 00:25 |
| Bloglines | 576 | 2.86 MB | 31 Oct 2008 - 23:13 |
| Unknown robot (identified by 'bot*') | 395+93 | 393.35 MB | 31 Oct 2008 - 13:34 |
| Ask | 346+43 | 34.87 MB | 31 Oct 2008 - 23:45 |
| BaiDuSpider | 183+7 | 2.12 MB | 31 Oct 2008 - 09:06 |
| Unknown robot (identified by empty user agent string) | 160+16 | 66.51 MB | 31 Oct 2008 - 23:51 |
| Unknown robot (identified by 'discovery') | 126+1 | 1.37 MB | 17 Oct 2008 - 01:41 |
| Harvest | 65 | 5.00 MB | 28 Oct 2008 - 16:36 |
| MSIECrawler | 15+46 | 71.82 KB | 31 Oct 2008 - 04:17 |
| Voila | 28+18 | 5.87 MB | 30 Oct 2008 - 10:48 |
| Exabot | 34+11 | 201.04 KB | 25 Oct 2008 - 01:23 |
| Jakarta commons-httpclient | 41+1 | 21.59 MB | 31 Oct 2008 - 11:55 |
| Unknown robot (identified by 'robot') | 22+14 | 7.92 MB | 28 Oct 2008 - 01:42 |
| Nutch | 15+17 | 10.01 MB | 31 Oct 2008 - 12:32 |
| MSRBOT | 23+9 | 2.09 MB | 21 Oct 2008 - 22:46 |
| Speedy Spider | 20+10 | 10.32 MB | 30 Oct 2008 - 16:04 |
| twiceler | 0+23 | 1.98 KB | 31 Oct 2008 - 16:43 |
| Susie | 14 | 73.00 KB | 15 Oct 2008 - 18:29 |
| archive.org bot | 8+6 | 12.63 MB | 31 Oct 2008 - 02:49 |
| Heritrix | 7+6 | 5.23 MB | 25 Oct 2008 - 06:11 |
| BecomeBot | 2+4 | 99.38 KB | 22 Oct 2008 - 08:20 |
| Perl tool | 5 | 942.28 KB | 24 Oct 2008 - 15:19 |
| WGet tools | 3+1 | 2.44 MB | 28 Oct 2008 - 05:41 |
| Grub.org | 2+2 | 1.30 MB | 04 Oct 2008 - 08:40 |
| BSpider | 0+4 | 352 Bytes | 24 Oct 2008 - 07:30 |
| Alexa (IA Archiver) | 2+2 | 105.96 KB | 31 Oct 2008 - 12:16 |
| yacy | 3+1 | 21.30 KB | 24 Oct 2008 - 02:00 |
| BBot | 4 | 13.45 MB | 30 Oct 2008 - 00:33 |
| Yandex bot | 2+2 | 10.46 KB | 28 Oct 2008 - 13:02 |
| Sogou Spider | 4 | 0 | 23 Oct 2008 - 22:14 |
| ichiro | 2+1 | 87.43 KB | 30 Oct 2008 - 06:44 |
| The web archive (IA Archiver) | 0+2 | 176 Bytes | 24 Oct 2008 - 09:56 |
| FaceBook bot | 2 | 2.43 MB | 23 Oct 2008 - 22:26 |
| CFNetwork | 2 | 2.43 MB | 10 Oct 2008 - 12:06 |
| MJ12bot | 1+1 | 5.23 KB | 12 Oct 2008 - 07:51 |
| EasyDL | 1 | 28.37 KB | 29 Oct 2008 - 08:18 |
| HTTrack off-line browser | 0+1 | 88 Bytes | 03 Oct 2008 - 04:43 |
| lwp-trivial | 1 | 2.69 KB | 01 Oct 2008 - 13:05 |
| lwp-request | 1 | 0 | 03 Oct 2008 - 23:29 |