| 50 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 1105251+3032 | 8.97 GB | 31 Dec 2011 - 23:59 |
| Googlebot | 43553+32 | 19.79 GB | 31 Dec 2011 - 23:57 |
| Unknown robot (identified by 'bot*') | 12002+885 | 3.97 GB | 31 Dec 2011 - 23:57 |
| Unknown robot (identified by 'robot') | 10079+29 | 192.61 MB | 30 Dec 2011 - 23:27 |
| Unknown robot (identified by empty user agent string) | 3597+23 | 977.84 MB | 31 Dec 2011 - 22:37 |
| BaiDuSpider | 3471+83 | 514.66 MB | 31 Dec 2011 - 23:47 |
| Yandex bot | 3221+32 | 1.71 GB | 31 Dec 2011 - 23:58 |
| Feedfetcher-Google | 881 | 4.79 MB | 31 Dec 2011 - 23:47 |
| Python-urllib | 721+3 | 545.86 MB | 30 Dec 2011 - 09:16 |
| lwp-trivial | 718 | 10.13 MB | 23 Dec 2011 - 13:56 |
| MSNBot | 467+14 | 47.74 MB | 31 Dec 2011 - 01:20 |
| larbin | 445+8 | 47.78 MB | 12 Dec 2011 - 23:35 |
| yacy | 431+19 | 82.84 MB | 30 Dec 2011 - 14:27 |
| Unknown robot (identified by 'spider') | 389+16 | 56.37 MB | 31 Dec 2011 - 22:04 |
| Unknown robot (identified by hit on 'robots.txt') | 0+355 | 10.75 KB | 31 Dec 2011 - 14:29 |
| Speedy Spider | 167+100 | 27.95 MB | 25 Dec 2011 - 01:19 |
| Custo | 170+47 | 333.54 MB | 21 Dec 2011 - 13:11 |
| Java (Often spam bot) | 190+2 | 141.46 MB | 31 Dec 2011 - 21:54 |
| Unknown robot (identified by '*bot') | 83+83 | 1016.69 KB | 31 Dec 2011 - 13:40 |
| Nutch | 82+44 | 19.02 MB | 31 Dec 2011 - 04:17 |
| WordPress | 126 | 47.75 MB | 30 Dec 2011 - 22:40 |
| Unknown robot (identified by 'discovery') | 105+17 | 27.08 MB | 27 Dec 2011 - 22:59 |
| Yahoo Slurp | 61+39 | 27.20 MB | 31 Dec 2011 - 21:46 |
| MJ12bot | 64+23 | 5.32 MB | 31 Dec 2011 - 12:33 |
| OutfoxBot/YodaoBot | 84 | 598.34 KB | 31 Dec 2011 - 00:17 |
| FaceBook bot | 83 | 5.58 MB | 30 Dec 2011 - 17:31 |
| Jakarta commons-httpclient | 76 | 8.74 MB | 31 Dec 2011 - 09:38 |
| MSNBot-media | 48+20 | 2.45 MB | 30 Dec 2011 - 18:47 |
| Harvest | 58 | 169.73 KB | 30 Dec 2011 - 16:16 |
| GigaBot | 24+27 | 211.80 KB | 31 Dec 2011 - 09:29 |
| Sogou Spider | 40+8 | 35.03 MB | 31 Dec 2011 - 06:43 |
| Exabot | 31+10 | 459.89 KB | 31 Dec 2011 - 06:50 |
| bender focused_crawler | 18+2 | 66.38 MB | 11 Dec 2011 - 00:04 |
| Perl tool | 19 | 1.90 MB | 29 Dec 2011 - 23:12 |
| WGet tools | 17 | 12.44 MB | 22 Dec 2011 - 06:33 |
| Mail.ru bot | 12 | 1.93 MB | 23 Dec 2011 - 00:34 |
| Findlinks | 6+6 | 224.89 KB | 31 Dec 2011 - 19:46 |
| CFNetwork | 11 | 8.07 MB | 28 Dec 2011 - 21:40 |
| Alexa (IA Archiver) | 0+9 | 279 Bytes | 29 Dec 2011 - 01:32 |
| DoCoMo | 3+3 | 57.21 KB | 10 Dec 2011 - 03:27 |
| legs | 3+3 | 1.29 MB | 29 Dec 2011 - 09:12 |
| archive.org bot | 3+3 | 2.72 MB | 29 Dec 2011 - 04:08 |
| SeznamBot | 2+2 | 1.21 MB | 22 Dec 2011 - 06:10 |
| FavIconizer | 3 | 21.37 KB | 26 Dec 2011 - 09:25 |
| T-H-U-N-D-E-R-S-T-O-N-E | 2 | 2.00 MB | 22 Dec 2011 - 15:06 |
| HTTrack off-line browser | 2 | 3.14 MB | 03 Dec 2011 - 09:08 |
| Netcraft | 2 | 7.12 KB | 30 Dec 2011 - 01:02 |
| Motor | 1 | 59.26 KB | 02 Dec 2011 - 18:41 |
| Heritrix | 1 | 7.12 KB | 29 Dec 2011 - 13:44 |
| Others | 0 | 0 | |