| 55 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 1172844+1188 | 32.41 GB | 31 May 2011 - 23:59 |
| Yahoo Slurp | 44535+99 | 15.09 GB | 31 May 2011 - 23:59 |
| Googlebot | 39457+34 | 21.11 GB | 31 May 2011 - 23:56 |
| Yandex bot | 1084+31 | 395.25 MB | 31 May 2011 - 23:53 |
| bender focused_crawler | 544+108 | 976.12 MB | 31 May 2011 - 23:47 |
| Unknown robot (identified by empty user agent string) | 748+36 | 353.09 MB | 31 May 2011 - 23:36 |
| Unknown robot (identified by '*bot') | 171+84 | 2.34 MB | 31 May 2011 - 23:36 |
| Unknown robot (identified by 'bot*') | 8359+344 | 1.48 GB | 31 May 2011 - 23:32 |
| Feedfetcher-Google | 239 | 1.51 MB | 31 May 2011 - 23:23 |
| BaiDuSpider | 381+48 | 39.17 MB | 31 May 2011 - 23:22 |
| WGet tools | 49+1 | 119.72 MB | 31 May 2011 - 23:16 |
| Sogou Spider | 140+8 | 79.69 MB | 31 May 2011 - 21:19 |
| FaceBook bot | 35 | 151.96 KB | 31 May 2011 - 21:11 |
| Custo | 339+45 | 137.87 MB | 31 May 2011 - 21:05 |
| MSNBot | 120+22 | 821.48 KB | 31 May 2011 - 19:36 |
| Unknown robot (identified by hit on 'robots.txt') | 0+218 | 6.21 KB | 31 May 2011 - 18:54 |
| Harvest | 49 | 195.95 KB | 31 May 2011 - 16:36 |
| Findlinks | 20+19 | 749.60 KB | 31 May 2011 - 16:15 |
| MJ12bot | 9+9 | 1.32 MB | 31 May 2011 - 15:18 |
| OutfoxBot/YodaoBot | 133 | 947.37 KB | 31 May 2011 - 13:26 |
| Exabot | 31+15 | 446.10 KB | 31 May 2011 - 13:10 |
| Unknown robot (identified by 'spider') | 36+18 | 3.58 MB | 31 May 2011 - 12:31 |
| EasyDL | 1 | 13.46 KB | 31 May 2011 - 03:45 |
| Speedy Spider | 125+91 | 28.90 MB | 31 May 2011 - 01:06 |
| Java (Often spam bot) | 136+1 | 14.74 MB | 31 May 2011 - 00:34 |
| CFNetwork | 8 | 9.02 MB | 30 May 2011 - 21:36 |
| Unknown robot (identified by 'robot') | 983+21 | 64.95 MB | 30 May 2011 - 18:14 |
| MSNBot-media | 37+17 | 1.64 MB | 30 May 2011 - 04:21 |
| Jakarta commons-httpclient | 54 | 5.41 MB | 30 May 2011 - 00:23 |
| Perl tool | 11 | 328.68 KB | 29 May 2011 - 20:57 |
| Unknown robot (identified by 'discovery') | 82+86 | 47.01 MB | 29 May 2011 - 16:25 |
| Python-urllib | 15 | 12.30 MB | 29 May 2011 - 05:43 |
| Netcraft | 2 | 14.25 KB | 28 May 2011 - 15:20 |
| Alexa (IA Archiver) | 0+8 | 248 Bytes | 28 May 2011 - 14:56 |
| WordPress | 58 | 18.05 MB | 28 May 2011 - 03:40 |
| Nutch | 115+13 | 12.29 MB | 27 May 2011 - 19:57 |
| DoCoMo | 6+2 | 7.03 MB | 27 May 2011 - 19:41 |
| FavIconizer | 3 | 21.37 KB | 27 May 2011 - 19:21 |
| Motor | 24 | 9.28 MB | 24 May 2011 - 19:47 |
| Ask | 5+5 | 173.55 KB | 24 May 2011 - 14:55 |
| Powermarks | 6 | 41.08 KB | 24 May 2011 - 13:27 |
| ichiro | 9+5 | 61.80 KB | 24 May 2011 - 12:14 |
| legs | 5+10 | 4.10 MB | 23 May 2011 - 23:45 |
| Steeler | 4+6 | 2.35 MB | 23 May 2011 - 20:13 |
| psbot | 2+2 | 18.94 KB | 23 May 2011 - 11:43 |
| MSIECrawler | 0+3 | 93 Bytes | 22 May 2011 - 09:56 |
| lwp-trivial | 2 | 14.25 KB | 21 May 2011 - 23:16 |
| HTTrack off-line browser | 2 | 2.43 MB | 21 May 2011 - 00:12 |
| Sunrise | 1 | 3.13 MB | 19 May 2011 - 22:41 |
| The web archive (IA Archiver) | 0+4 | 124 Bytes | 19 May 2011 - 12:30 |
| yacy | 2 | 331.31 KB | 18 May 2011 - 14:31 |
| BBot | 2 | 1.31 MB | 16 May 2011 - 12:28 |
| GigaBot | 2+3 | 12.65 KB | 11 May 2011 - 21:19 |
| archive.org bot | 1+1 | 37.48 KB | 10 May 2011 - 16:29 |
| Voyager | 3 | 3.64 MB | 08 May 2011 - 17:23 |