| 45 different robots | Hits | Bandwidth | Last visit |
|---|
| Ask | 1341+56 | 126.60 MB | 30 Nov 2006 - 23:52 |
| Yahoo Slurp | 2288+712 | 3.18 GB | 30 Nov 2006 - 23:36 |
| Jakarta commons-httpclient | 11+2 | 16.14 MB | 30 Nov 2006 - 23:31 |
| Unknown robot (identified by 'crawl') | 11030+613 | 4.91 GB | 30 Nov 2006 - 23:28 |
| Googlebot | 1090+29 | 723.55 MB | 30 Nov 2006 - 23:24 |
| twiceler | 0+1 | 88 Bytes | 30 Nov 2006 - 21:30 |
| Unknown robot (identified by hit on 'robots.txt') | 0+88 | 7.56 KB | 30 Nov 2006 - 20:14 |
| Java (Often spam bot) | 624+1 | 3.43 MB | 30 Nov 2006 - 19:18 |
| Voyager | 101+18 | 763.01 KB | 30 Nov 2006 - 17:17 |
| Sina Iask Spider | 31 | 159.48 KB | 30 Nov 2006 - 15:08 |
| Findlinks | 17+16 | 248.05 KB | 30 Nov 2006 - 08:46 |
| MSNBot | 98+67 | 17.07 MB | 30 Nov 2006 - 06:25 |
| Unknown robot (identified by 'robot') | 10+10 | 28.75 KB | 30 Nov 2006 - 03:50 |
| Unknown robot (identified by 'bot*') | 1915+19 | 349.95 MB | 30 Nov 2006 - 02:12 |
| psbot | 1+1 | 88 Bytes | 29 Nov 2006 - 23:55 |
| Unknown robot (identified by empty user agent string) | 66+10 | 54.73 MB | 29 Nov 2006 - 21:53 |
| Custo | 5 | 1.96 MB | 29 Nov 2006 - 16:49 |
| ZyBorg | 21+2 | 325.91 KB | 29 Nov 2006 - 14:39 |
| WGet tools | 7+2 | 12.09 MB | 29 Nov 2006 - 10:58 |
| Exabot | 45+14 | 298.00 KB | 29 Nov 2006 - 07:06 |
| Heritrix | 11+4 | 48.91 MB | 28 Nov 2006 - 23:37 |
| ConveraCrawler | 481+2 | 870.14 MB | 28 Nov 2006 - 16:09 |
| Harvest | 30 | 1.67 MB | 28 Nov 2006 - 15:36 |
| MSNBot-media | 454+21 | 3.54 MB | 28 Nov 2006 - 11:12 |
| Cfetch | 5 | 0 | 28 Nov 2006 - 05:02 |
| LinkChecker | 493+2 | 3.88 MB | 28 Nov 2006 - 02:44 |
| ichiro | 2+2 | 5.75 KB | 27 Nov 2006 - 22:57 |
| BaiDuSpider | 2+1 | 88 Bytes | 27 Nov 2006 - 13:44 |
| CFNetwork | 5 | 10.29 MB | 25 Nov 2006 - 15:55 |
| ASpider (Associative Spider) | 1+2 | 11.66 KB | 23 Nov 2006 - 00:53 |
| The web archive (IA Archiver) | 0+4 | 352 Bytes | 21 Nov 2006 - 04:25 |
| Sogou Spider | 7+4 | 1.16 MB | 20 Nov 2006 - 09:09 |
| lwp-trivial | 1 | 2.69 KB | 20 Nov 2006 - 07:17 |
| Nutch | 3+3 | 15.69 KB | 19 Nov 2006 - 11:12 |
| MJ12bot | 1+1 | 4.27 KB | 19 Nov 2006 - 01:35 |
| larbin | 1+1 | 5.23 KB | 19 Nov 2006 - 00:16 |
| nicebot | 1 | 7.44 KB | 18 Nov 2006 - 22:38 |
| BBot | 2 | 210.80 KB | 17 Nov 2006 - 10:02 |
| Perl tool | 5 | 39.16 KB | 14 Nov 2006 - 16:56 |
| MSIECrawler | 4+1 | 18.86 KB | 14 Nov 2006 - 15:30 |
| NutchCVS | 76+4 | 1.27 MB | 14 Nov 2006 - 00:41 |
| Alexa (IA Archiver) | 1+1 | 1.21 MB | 11 Nov 2006 - 13:29 |
| Pompos | 0+1 | 88 Bytes | 09 Nov 2006 - 03:47 |
| Netcraft | 3 | 0 | 05 Nov 2006 - 20:43 |
| GigaBot | 1+1 | 2.52 KB | 01 Nov 2006 - 18:04 |