| 39 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 19150+407 | 17.38 GB | 30 Sep 2006 - 23:15 |
| Heritrix | 6097+20 | 13.34 GB | 30 Sep 2006 - 15:35 |
| NutchCVS | 1622+4 | 14.05 MB | 26 Sep 2006 - 13:51 |
| Unknown robot (identified by 'bot*') | 1587+39 | 630.43 MB | 30 Sep 2006 - 22:18 |
| Yahoo Slurp | 988+526 | 1.41 GB | 30 Sep 2006 - 23:55 |
| Ask | 735+93 | 6.57 MB | 30 Sep 2006 - 13:17 |
| Googlebot | 352+24 | 253.62 MB | 30 Sep 2006 - 06:02 |
| LinkChecker | 329+2 | 2.55 MB | 30 Sep 2006 - 15:29 |
| MSNBot | 179+119 | 13.83 MB | 30 Sep 2006 - 12:41 |
| Java (Often spam bot) | 290 | 12.20 MB | 29 Sep 2006 - 22:18 |
| ConveraCrawler | 262+1 | 365.11 MB | 11 Sep 2006 - 05:40 |
| Shim-Crawler | 71+4 | 492.38 KB | 29 Sep 2006 - 12:53 |
| MSNBot-media | 43+11 | 348.42 KB | 28 Sep 2006 - 13:24 |
| Findlinks | 34+14 | 430.68 KB | 30 Sep 2006 - 17:07 |
| Unknown robot (identified by empty user agent string) | 28+15 | 50.99 MB | 28 Sep 2006 - 14:00 |
| Perl tool | 19 | 407.50 KB | 30 Sep 2006 - 20:51 |
| WGet tools | 17+1 | 3.70 MB | 21 Sep 2006 - 02:13 |
| Unknown robot (identified by hit on 'robots.txt') | 0+17 | 1.46 KB | 30 Sep 2006 - 00:34 |
| Harvest | 16 | 22.34 KB | 26 Sep 2006 - 16:36 |
| larbin | 12+3 | 36.26 KB | 11 Sep 2006 - 11:03 |
| BaiDuSpider | 5+2 | 1.30 MB | 28 Sep 2006 - 22:51 |
| Voyager | 3+3 | 7.39 KB | 14 Sep 2006 - 01:59 |
| Girafabot | 3+2 | 13.80 KB | 19 Sep 2006 - 05:31 |
| Exabot | 3+2 | 17.76 KB | 25 Sep 2006 - 22:20 |
| ichiro | 3+2 | 13.27 KB | 25 Sep 2006 - 14:27 |
| GigaBot | 2+2 | 8.01 KB | 25 Sep 2006 - 04:14 |
| Jakarta commons-httpclient | 3 | 17.96 MB | 26 Sep 2006 - 14:42 |
| psbot | 2+1 | 13.92 KB | 06 Sep 2006 - 19:31 |
| MSRBOT | 2+1 | 2.42 MB | 30 Sep 2006 - 05:25 |
| Cfetch | 2 | 0 | 15 Sep 2006 - 12:28 |
| Custo | 2 | 1.10 MB | 05 Sep 2006 - 08:53 |
| nicebot | 2 | 7.71 KB | 10 Sep 2006 - 15:22 |
| MSIECrawler | 0+2 | 88 Bytes | 20 Sep 2006 - 08:22 |
| Sogou Spider | 1+1 | 5.23 KB | 29 Sep 2006 - 21:55 |
| Walhello appie | 0+1 | 88 Bytes | 30 Sep 2006 - 09:45 |
| CFNetwork | 1 | 756.16 KB | 21 Sep 2006 - 00:28 |
| yacy | 0+1 | 88 Bytes | 30 Sep 2006 - 16:42 |
| Python-urllib | 1 | 1.21 MB | 14 Sep 2006 - 18:37 |
| Others | 0 | 0 | |