| 50 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 1171895+41534 | 17.40 GB | 31 Jul 2012 - 23:59 |
| Googlebot | 52514+38 | 26.70 GB | 31 Jul 2012 - 23:59 |
| Yandex bot | 32102+39 | 11.95 GB | 31 Jul 2012 - 23:51 |
| legs | 26176+235 | 25.50 GB | 31 Jul 2012 - 23:58 |
| Unknown robot (identified by 'bot*') | 25476+347 | 10.04 GB | 31 Jul 2012 - 23:59 |
| BaiDuSpider | 19975+73 | 257.86 MB | 31 Jul 2012 - 23:56 |
| Heritrix | 4300+5 | 43.91 MB | 24 Jul 2012 - 02:35 |
| Unknown robot (identified by 'spider') | 1220+29 | 263.10 MB | 31 Jul 2012 - 23:41 |
| Unknown robot (identified by hit on 'robots.txt') | 0+902 | 27.31 KB | 31 Jul 2012 - 23:38 |
| Sogou Spider | 703+3 | 179.47 MB | 31 Jul 2012 - 22:19 |
| Unknown robot (identified by empty user agent string) | 538+15 | 634.85 MB | 31 Jul 2012 - 22:55 |
| yacy | 311+2 | 46.08 MB | 26 Jul 2012 - 09:21 |
| Feedfetcher-Google | 266 | 11.33 MB | 31 Jul 2012 - 23:40 |
| Java (Often spam bot) | 262 | 14.21 MB | 31 Jul 2012 - 00:58 |
| WordPress | 258 | 28.76 MB | 31 Jul 2012 - 22:48 |
| Nutch | 220+36 | 24.36 MB | 31 Jul 2012 - 14:19 |
| Unknown robot (identified by 'robot') | 222+20 | 190.78 MB | 31 Jul 2012 - 00:56 |
| BSpider | 123+19 | 10.88 MB | 31 Jul 2012 - 20:17 |
| Unknown robot (identified by '*bot') | 62+73 | 1.28 MB | 31 Jul 2012 - 22:43 |
| psbot | 104+9 | 2.54 MB | 26 Jul 2012 - 04:06 |
| Harvest | 77+1 | 6.35 MB | 31 Jul 2012 - 16:36 |
| MJ12bot | 59+18 | 6.39 MB | 31 Jul 2012 - 23:05 |
| Unknown robot (identified by 'discovery') | 58+15 | 44.62 MB | 28 Jul 2012 - 13:07 |
| Jakarta commons-httpclient | 68 | 2.54 MB | 31 Jul 2012 - 10:12 |
| Exabot | 53+10 | 936.76 KB | 31 Jul 2012 - 21:17 |
| archive.org bot | 52+11 | 33.91 MB | 31 Jul 2012 - 23:16 |
| Yahoo Slurp | 53+8 | 60.57 MB | 31 Jul 2012 - 23:01 |
| HTTrack off-line browser | 58+3 | 4.22 MB | 21 Jul 2012 - 14:45 |
| MagpieRSS | 48+12 | 338.52 KB | 31 Jul 2012 - 09:57 |
| MSNBot | 46+13 | 911.39 KB | 25 Jul 2012 - 20:13 |
| OutfoxBot/YodaoBot | 54+2 | 429.99 KB | 31 Jul 2012 - 21:41 |
| Mail.ru bot | 21+9 | 9.73 MB | 31 Jul 2012 - 05:55 |
| FaceBook bot | 28 | 691.16 KB | 31 Jul 2012 - 18:42 |
| WGet tools | 22 | 15.47 MB | 28 Jul 2012 - 18:51 |
| Alexa (IA Archiver) | 1+19 | 15.15 KB | 30 Jul 2012 - 04:28 |
| Python-urllib | 8+8 | 46.19 MB | 23 Jul 2012 - 23:16 |
| Perl tool | 15 | 85.41 KB | 30 Jul 2012 - 13:39 |
| Powermarks | 14 | 1.40 MB | 28 Jul 2012 - 09:56 |
| DoCoMo | 8+5 | 287.56 KB | 12 Jul 2012 - 01:57 |
| Turn It In | 4+7 | 4.48 MB | 24 Jul 2012 - 04:34 |
| CFNetwork | 9 | 5.17 MB | 30 Jul 2012 - 22:10 |
| MSNBot-media | 6+3 | 116.81 KB | 29 Jul 2012 - 04:59 |
| bender focused_crawler | 2+4 | 11.06 MB | 31 Jul 2012 - 07:48 |
| W3C Link Checker | 3+3 | 93 Bytes | 31 Jul 2012 - 18:40 |
| SeznamBot | 2+2 | 1.30 MB | 31 Jul 2012 - 01:24 |
| NG 1.x (Exalead) | 4 | 7.66 MB | 25 Jul 2012 - 07:52 |
| Netcraft | 3 | 7.04 KB | 06 Jul 2012 - 08:31 |
| FavIconizer | 2 | 14.09 KB | 10 Jul 2012 - 23:24 |
| WebFilter | 1 | 8.75 MB | 13 Jul 2012 - 08:43 |
| Others | 0 | 0 | |