| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 1295434+21917 | 26.39 GB | 31 Jan 2012 - 23:49 |
| Python-urllib | 108014+8 | 26.40 GB | 31 Jan 2012 - 23:37 |
| Googlebot | 49795+34 | 29.50 GB | 31 Jan 2012 - 23:59 |
| Yandex bot | 24130+36 | 7.29 GB | 31 Jan 2012 - 22:38 |
| Unknown robot (identified by 'bot*') | 11575+883 | 3.60 GB | 31 Jan 2012 - 23:22 |
| BaiDuSpider | 8378+74 | 623.02 MB | 31 Jan 2012 - 23:48 |
| Unknown robot (identified by 'robot') | 3724+22 | 231.92 MB | 28 Jan 2012 - 10:48 |
| Nutch | 894+258 | 183.23 MB | 31 Jan 2012 - 23:38 |
| Unknown robot (identified by empty user agent string) | 944+33 | 973.24 MB | 31 Jan 2012 - 23:22 |
| Feedfetcher-Google | 886 | 4.87 MB | 31 Jan 2012 - 23:59 |
| Unknown robot (identified by 'spider') | 700+19 | 206.01 MB | 31 Jan 2012 - 23:09 |
| Java (Often spam bot) | 382+1 | 137.17 MB | 31 Jan 2012 - 13:13 |
| Unknown robot (identified by 'discovery') | 366+16 | 1.24 GB | 31 Jan 2012 - 15:19 |
| yacy | 328+9 | 60.46 MB | 31 Jan 2012 - 09:44 |
| Unknown robot (identified by hit on 'robots.txt') | 0+334 | 10.11 KB | 31 Jan 2012 - 23:42 |
| Sogou Spider | 253+7 | 76.22 MB | 31 Jan 2012 - 23:37 |
| WordPress | 130 | 85.98 MB | 31 Jan 2012 - 20:23 |
| MJ12bot | 108+22 | 7.81 MB | 30 Jan 2012 - 22:41 |
| Unknown robot (identified by '*bot') | 43+63 | 846.40 KB | 31 Jan 2012 - 23:34 |
| FaceBook bot | 106 | 5.83 MB | 31 Jan 2012 - 19:58 |
| bender focused_crawler | 103+3 | 28.36 MB | 15 Jan 2012 - 04:37 |
| Yahoo Slurp | 51+43 | 50.93 MB | 31 Jan 2012 - 16:13 |
| MSNBot-media | 55+27 | 2.39 MB | 31 Jan 2012 - 04:27 |
| OutfoxBot/YodaoBot | 70 | 498.61 KB | 27 Jan 2012 - 05:34 |
| Jakarta commons-httpclient | 64 | 6.84 MB | 31 Jan 2012 - 15:35 |
| Harvest | 58 | 335.96 KB | 31 Jan 2012 - 15:36 |
| archive.org bot | 37+12 | 19.41 MB | 31 Jan 2012 - 23:15 |
| CFNetwork | 38 | 37.94 MB | 23 Jan 2012 - 23:54 |
| WGet tools | 37 | 26.55 MB | 30 Jan 2012 - 04:02 |
| Speedy Spider | 21+15 | 15.22 MB | 31 Jan 2012 - 10:36 |
| Exabot | 22+8 | 255.70 KB | 31 Jan 2012 - 22:02 |
| MSNBot | 26+3 | 579.20 KB | 25 Jan 2012 - 15:59 |
| BSpider | 0+28 | 868 Bytes | 31 Jan 2012 - 14:28 |
| Powermarks | 18 | 3.07 MB | 25 Jan 2012 - 08:26 |
| Perl tool | 16 | 12.62 MB | 31 Jan 2012 - 01:49 |
| GigaBot | 8+8 | 57.23 KB | 31 Jan 2012 - 12:46 |
| Findlinks | 6+7 | 224.05 KB | 29 Jan 2012 - 23:10 |
| psbot | 4+5 | 142.31 KB | 25 Jan 2012 - 12:21 |
| Mail.ru bot | 5+2 | 2.91 MB | 31 Jan 2012 - 00:08 |
| HTTrack off-line browser | 7 | 10.78 MB | 21 Jan 2012 - 12:16 |
| ichiro | 4+3 | 109.82 KB | 26 Jan 2012 - 02:40 |
| LinkChecker | 4+2 | 26.63 KB | 25 Jan 2012 - 09:10 |
| Alexa (IA Archiver) | 0+6 | 186 Bytes | 30 Jan 2012 - 20:35 |
| W3C Link Checker | 3+3 | 93 Bytes | 25 Jan 2012 - 03:23 |
| SeznamBot | 2+3 | 93 Bytes | 15 Jan 2012 - 02:38 |
| FavIconizer | 5 | 2.45 MB | 19 Jan 2012 - 09:36 |
| DoCoMo | 1+2 | 30.35 KB | 25 Jan 2012 - 07:46 |
| Heritrix | 1+1 | 1.21 MB | 04 Jan 2012 - 18:06 |
| Raven Search | 2 | 1.39 MB | 15 Jan 2012 - 10:03 |
| legs | 0+2 | 62 Bytes | 30 Jan 2012 - 16:27 |
| BBot | 2 | 2.43 MB | 29 Jan 2012 - 10:36 |
| SuperBot | 1 | 1.21 MB | 03 Jan 2012 - 20:56 |
| UCSD Crawl | 1 | 1.79 MB | 10 Jan 2012 - 14:23 |
| Turn It In | 0+1 | 31 Bytes | 30 Jan 2012 - 09:46 |
| W3C Validator | 1 | 432.86 KB | 18 Jan 2012 - 12:30 |
| Pioneer | 1 | 7.12 KB | 23 Jan 2012 - 01:34 |
| VORTEX | 1 | 37.45 KB | 16 Jan 2012 - 15:05 |
| MSIECrawler | 0+1 | 31 Bytes | 23 Jan 2012 - 02:05 |
| Netcraft | 1 | 0 | 27 Jan 2012 - 12:16 |