| 49 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 34253+56 | 3.20 GB | 30 Sep 2015 - 23:59 |
| Yandex bot | 4832+161 | 2.06 GB | 30 Sep 2015 - 23:59 |
| Unknown robot (identified by 'bot*') | 37625+565 | 10.91 GB | 30 Sep 2015 - 23:57 |
| Googlebot | 30809+726 | 20.36 GB | 30 Sep 2015 - 23:56 |
| BaiDuSpider | 1208 | 499.36 MB | 30 Sep 2015 - 23:53 |
| Nutch | 199+60 | 81.83 MB | 30 Sep 2015 - 23:38 |
| Feedfetcher-Google | 185 | 11.61 MB | 30 Sep 2015 - 23:32 |
| Unknown robot (identified by 'crawl') | 62553+138 | 1.51 GB | 30 Sep 2015 - 22:06 |
| Unknown robot (identified by hit on 'robots.txt') | 0+278 | 24.16 KB | 30 Sep 2015 - 21:39 |
| FavIconizer | 174 | 29.42 MB | 30 Sep 2015 - 21:28 |
| MagpieRSS | 136 | 1.14 MB | 30 Sep 2015 - 21:11 |
| Unknown robot (identified by 'robot') | 78+154 | 20.36 MB | 30 Sep 2015 - 21:11 |
| MJ12bot | 96+9 | 9.55 MB | 30 Sep 2015 - 21:06 |
| Java (Often spam bot) | 171+3 | 10.66 MB | 30 Sep 2015 - 20:39 |
| LinkChecker | 27 | 3.66 MB | 30 Sep 2015 - 20:32 |
| Unknown robot (identified by empty user agent string) | 397+15 | 144.38 MB | 30 Sep 2015 - 18:10 |
| Exabot | 53+20 | 1021.58 KB | 30 Sep 2015 - 17:45 |
| FaceBook bot | 68 | 2.31 MB | 30 Sep 2015 - 14:36 |
| yacy | 163+10 | 50.29 MB | 30 Sep 2015 - 13:56 |
| archive.org bot | 4676+66 | 355.22 MB | 30 Sep 2015 - 10:35 |
| Jakarta commons-httpclient | 59 | 198.70 KB | 30 Sep 2015 - 09:53 |
| WGet tools | 129+1 | 207.05 MB | 30 Sep 2015 - 06:13 |
| WordPress | 286 | 68.20 MB | 30 Sep 2015 - 05:45 |
| Unknown robot (identified by 'spider') | 607+23 | 33.31 MB | 30 Sep 2015 - 05:06 |
| Sogou Spider | 566+37 | 207.96 MB | 29 Sep 2015 - 23:58 |
| SeznamBot | 11+8 | 1.92 MB | 29 Sep 2015 - 14:47 |
| CFNetwork | 9 | 11.81 MB | 29 Sep 2015 - 12:18 |
| Harvest | 36 | 95.18 KB | 28 Sep 2015 - 22:46 |
| Sift | 13 | 201.01 KB | 28 Sep 2015 - 07:44 |
| HTTrack off-line browser | 41+1 | 35.42 MB | 27 Sep 2015 - 20:11 |
| Phantom | 23 | 2.74 MB | 27 Sep 2015 - 16:29 |
| BetaBot | 12+2 | 154.25 KB | 26 Sep 2015 - 19:10 |
| Python-urllib | 27+2 | 25.44 MB | 25 Sep 2015 - 00:36 |
| Mail.ru bot | 25+18 | 19.11 MB | 24 Sep 2015 - 13:51 |
| Turn It In | 6+2 | 2.58 MB | 22 Sep 2015 - 23:17 |
| CsCrawler | 1+1 | 8.65 KB | 21 Sep 2015 - 17:38 |
| Perl tool | 3 | 8.11 MB | 21 Sep 2015 - 09:32 |
| Unknown robot (identified by 'checker') | 2 | 1.92 MB | 20 Sep 2015 - 21:19 |
| Heritrix | 20+2 | 51.84 MB | 17 Sep 2015 - 01:30 |
| Web Core / Roots | 3+2 | 1.36 MB | 17 Sep 2015 - 00:12 |
| Unknown robot (identified by 'discovery') | 1 | 15.98 KB | 16 Sep 2015 - 11:38 |
| Y!J Yahoo Japan | 1+1 | 8.65 KB | 16 Sep 2015 - 11:12 |
| JoBo Java Web Robot | 1 | 37.45 KB | 14 Sep 2015 - 10:26 |
| MSNBot-media | 3 | 47.08 KB | 12 Sep 2015 - 11:47 |
| psbot | 868+30 | 13.73 MB | 11 Sep 2015 - 07:02 |
| larbin | 8+4 | 24.38 MB | 10 Sep 2015 - 11:09 |
| NG 2.x (Exalead) | 0+2 | 178 Bytes | 10 Sep 2015 - 01:07 |
| Netcraft | 2 | 8.56 KB | 08 Sep 2015 - 14:41 |
| Alexa (IA Archiver) | 2+1 | 32.98 KB | 05 Sep 2015 - 08:16 |