| 31 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 6685+599 | 518.68 MB | 30 Nov 2005 - 23:44 |
| Googlebot | 6795+67 | 16.19 GB | 30 Nov 2005 - 20:00 |
| MSNBot | 3574+115 | 6.85 GB | 30 Nov 2005 - 19:41 |
| WGet tools | 1264+1 | 2.75 GB | 28 Nov 2005 - 04:55 |
| psbot | 588+29 | 4.72 MB | 29 Nov 2005 - 17:06 |
| Java (Often spam bot) | 493 | 3.67 MB | 30 Nov 2005 - 19:32 |
| RufusBot Rufus Web Miner | 347+5 | 2.75 MB | 19 Nov 2005 - 05:35 |
| Ask | 314+32 | 2.28 MB | 29 Nov 2005 - 12:26 |
| Python-urllib | 282 | 2.29 MB | 25 Nov 2005 - 00:13 |
| ConveraCrawler | 87+1 | 187.41 MB | 07 Nov 2005 - 10:51 |
| Unknown robot (identified by 'bot*') | 43+17 | 272.23 KB | 13 Nov 2005 - 13:35 |
| ZyBorg | 46+6 | 390.04 KB | 30 Nov 2005 - 01:54 |
| Harvest | 40 | 55.85 KB | 29 Nov 2005 - 15:36 |
| Yahoo Slurp | 17+13 | 533.65 KB | 29 Nov 2005 - 04:56 |
| Unknown robot (identified by empty user agent string) | 4+15 | 11.82 KB | 27 Nov 2005 - 23:47 |
| Shim-Crawler | 9+6 | 40.88 KB | 13 Nov 2005 - 10:12 |
| The web archive (IA Archiver) | 2+3 | 7.81 KB | 16 Nov 2005 - 11:12 |
| HTTrack off-line browser | 3+2 | 10.90 KB | 19 Nov 2005 - 11:58 |
| BecomeBot | 2+2 | 10.46 KB | 22 Nov 2005 - 11:26 |
| larbin | 2+2 | 10.46 KB | 25 Nov 2005 - 19:59 |
| Turn It In | 2+2 | 2.69 KB | 24 Nov 2005 - 16:22 |
| Alexa (IA Archiver) | 1+1 | 441.55 KB | 03 Nov 2005 - 18:26 |
| Perl tool | 2 | 12.19 KB | 20 Nov 2005 - 22:01 |
| nicebot | 2 | 24.22 KB | 13 Nov 2005 - 05:47 |
| Findlinks | 1+1 | 5.23 KB | 22 Nov 2005 - 16:09 |
| Unknown robot (identified by 'robot') | 1+1 | 5.23 KB | 08 Nov 2005 - 02:13 |
| ichiro | 1+1 | 5.23 KB | 16 Nov 2005 - 11:07 |
| Cfetch | 1 | 0 | 15 Nov 2005 - 11:54 |
| Jakarta commons-httpclient | 0+1 | 88 Bytes | 05 Nov 2005 - 15:37 |
| sohu agent | 1 | 445 Bytes | 27 Nov 2005 - 13:35 |
| Others | 0 | 12 Bytes | |