| 44 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 14169+610 | 13.97 GB | 30 Nov 2008 - 23:57 |
| Unknown robot (identified by 'crawl') | 16136+737 | 5.01 GB | 30 Nov 2008 - 23:56 |
| Heritrix | 1+1 | 3.77 MB | 30 Nov 2008 - 23:48 |
| BaiDuSpider | 143+8 | 1.56 MB | 30 Nov 2008 - 23:33 |
| Unknown robot (identified by empty user agent string) | 100+23 | 48.07 MB | 30 Nov 2008 - 23:04 |
| MSNBot-media | 537+90 | 576.42 MB | 30 Nov 2008 - 22:50 |
| Bloglines | 266 | 1.32 MB | 30 Nov 2008 - 22:34 |
| MSNBot | 4879+521 | 5.72 GB | 30 Nov 2008 - 22:33 |
| Voila | 51+25 | 14.82 MB | 30 Nov 2008 - 21:42 |
| Speedy Spider | 25+19 | 16.01 MB | 30 Nov 2008 - 21:06 |
| Ask | 814+85 | 175.43 MB | 30 Nov 2008 - 20:59 |
| Googlebot | 7121+32 | 11.93 GB | 30 Nov 2008 - 20:57 |
| Voyager | 11+3 | 18.65 MB | 30 Nov 2008 - 20:17 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1029 | 67.80 KB | 30 Nov 2008 - 16:55 |
| Unknown robot (identified by 'bot*') | 2566+70 | 81.28 MB | 30 Nov 2008 - 11:20 |
| MSIECrawler | 1+25 | 1.22 MB | 30 Nov 2008 - 04:02 |
| Perl tool | 11 | 873.20 KB | 30 Nov 2008 - 01:31 |
| BSpider | 0+5 | 440 Bytes | 30 Nov 2008 - 00:50 |
| Sogou Spider | 8 | 4.36 MB | 29 Nov 2008 - 23:39 |
| Java (Often spam bot) | 215 | 3.24 MB | 29 Nov 2008 - 21:44 |
| Yandex bot | 8+8 | 41.84 KB | 29 Nov 2008 - 18:45 |
| GigaBot | 21+8 | 8.06 MB | 29 Nov 2008 - 14:55 |
| Nutch | 123+26 | 5.94 MB | 29 Nov 2008 - 14:24 |
| Custo | 2 | 351.62 KB | 29 Nov 2008 - 09:28 |
| twiceler | 0+14 | 1.20 KB | 29 Nov 2008 - 07:31 |
| WGet tools | 4+2 | 2.33 MB | 29 Nov 2008 - 05:09 |
| Exabot | 45+14 | 541.52 KB | 28 Nov 2008 - 06:10 |
| Unknown robot (identified by 'robot') | 24+25 | 9.50 MB | 27 Nov 2008 - 00:23 |
| CFNetwork | 2 | 1.38 MB | 26 Nov 2008 - 09:28 |
| YahooSeeker Yahoo! Blog crawler | 9+2 | 32.73 KB | 25 Nov 2008 - 22:51 |
| Harvest | 45 | 1.70 MB | 25 Nov 2008 - 15:36 |
| MJ12bot | 68+4 | 645.06 KB | 24 Nov 2008 - 22:05 |
| Jakarta commons-httpclient | 14+2 | 11.89 MB | 21 Nov 2008 - 13:00 |
| Python-urllib | 1 | 5.14 KB | 19 Nov 2008 - 08:05 |
| The web archive (IA Archiver) | 0+1 | 88 Bytes | 17 Nov 2008 - 14:15 |
| yacy | 3+2 | 15.61 KB | 14 Nov 2008 - 07:32 |
| Unknown robot (identified by 'spider') | 1 | 0 | 13 Nov 2008 - 12:41 |
| WordPress | 4 | 2.43 MB | 12 Nov 2008 - 04:41 |
| archive.org bot | 1+1 | 1.21 MB | 05 Nov 2008 - 17:25 |
| BecomeBot | 0+1 | 88 Bytes | 04 Nov 2008 - 09:37 |
| psbot | 1+1 | 88 Bytes | 03 Nov 2008 - 16:00 |
| HTTrack off-line browser | 1 | 685.47 KB | 03 Nov 2008 - 14:54 |
| ichiro | 10 | 29.44 KB | 01 Nov 2008 - 14:35 |
| ConveraCrawler | 43+1 | 1.97 MB | 01 Nov 2008 - 03:59 |