| 52 different robots | Hits | Bandwidth | Last visit |
|---|
| Yandex bot | 21401+118 | 16.83 GB | 30 Nov 2015 - 23:59 |
| Unknown robot (identified by empty user agent string) | 2307+10 | 114.22 MB | 30 Nov 2015 - 23:59 |
| Unknown robot (identified by 'bot*') | 40168+2174 | 17.08 GB | 30 Nov 2015 - 23:59 |
| Yahoo Slurp | 34073+45 | 3.70 GB | 30 Nov 2015 - 23:57 |
| BaiDuSpider | 1961 | 783.16 MB | 30 Nov 2015 - 23:56 |
| Unknown robot (identified by 'crawl') | 7983+185 | 320.23 MB | 30 Nov 2015 - 23:30 |
| Googlebot | 23360+733 | 14.78 GB | 30 Nov 2015 - 23:22 |
| Feedfetcher-Google | 114 | 5.73 MB | 30 Nov 2015 - 23:05 |
| Mail.ru bot | 222+40 | 6.37 MB | 30 Nov 2015 - 22:20 |
| Custo | 36526 | 268.31 MB | 30 Nov 2015 - 21:59 |
| HTTrack off-line browser | 9 | 9.29 MB | 30 Nov 2015 - 21:47 |
| MagpieRSS | 140 | 1.17 MB | 30 Nov 2015 - 20:58 |
| Unknown robot (identified by 'robot') | 67+167 | 29.59 MB | 30 Nov 2015 - 20:58 |
| Java (Often spam bot) | 619+6 | 46.36 MB | 30 Nov 2015 - 20:39 |
| FavIconizer | 246 | 142.00 MB | 30 Nov 2015 - 20:22 |
| Heritrix | 5+5 | 5.37 MB | 30 Nov 2015 - 19:34 |
| Unknown robot (identified by hit on 'robots.txt') | 0+262 | 22.77 KB | 30 Nov 2015 - 19:34 |
| Sogou Spider | 486+40 | 109.15 MB | 30 Nov 2015 - 18:59 |
| Exabot | 125+21 | 1.51 MB | 30 Nov 2015 - 18:23 |
| Python-urllib | 58+17 | 43.02 MB | 30 Nov 2015 - 18:20 |
| LinkChecker | 32 | 4.34 MB | 30 Nov 2015 - 17:53 |
| SeznamBot | 31+25 | 5.36 MB | 30 Nov 2015 - 16:27 |
| FaceBook bot | 53 | 1.89 MB | 30 Nov 2015 - 13:00 |
| Jakarta commons-httpclient | 91 | 950.41 KB | 30 Nov 2015 - 09:49 |
| Sift | 16 | 241.31 KB | 30 Nov 2015 - 04:55 |
| Unknown robot (identified by 'spider') | 582+18 | 19.13 MB | 30 Nov 2015 - 04:05 |
| Nutch | 20+22 | 6.52 MB | 30 Nov 2015 - 04:03 |
| WGet tools | 23 | 18.90 MB | 30 Nov 2015 - 00:43 |
| MJ12bot | 32+8 | 758.77 KB | 29 Nov 2015 - 19:35 |
| WordPress | 186 | 77.35 MB | 29 Nov 2015 - 09:51 |
| CFNetwork | 21 | 9.36 MB | 29 Nov 2015 - 09:01 |
| Perl tool | 12 | 10.37 MB | 28 Nov 2015 - 16:08 |
| SpiderBot | 5+5 | 7.81 MB | 28 Nov 2015 - 14:53 |
| MSNBot-media | 1 | 15.69 KB | 27 Nov 2015 - 20:06 |
| Unknown robot (identified by 'discovery') | 2 | 32.13 KB | 27 Nov 2015 - 13:43 |
| yacy | 150+8 | 53.76 MB | 27 Nov 2015 - 12:28 |
| archive.org bot | 6+8 | 18.74 MB | 27 Nov 2015 - 04:33 |
| Web Core / Roots | 2 | 31.63 KB | 26 Nov 2015 - 00:33 |
| Harvest | 14 | 24.72 KB | 25 Nov 2015 - 15:55 |
| CsCrawler | 1+1 | 8.65 KB | 23 Nov 2015 - 18:42 |
| BetaBot | 134+5 | 6.26 MB | 21 Nov 2015 - 07:31 |
| MSNBot | 3 | 32.40 KB | 20 Nov 2015 - 18:36 |
| MojeekBot | 1+1 | 8.65 KB | 18 Nov 2015 - 11:04 |
| psbot | 747+28 | 11.67 MB | 16 Nov 2015 - 17:17 |
| Raven Search | 2 | 0 | 15 Nov 2015 - 02:28 |
| Spiderman | 1 | 8.56 KB | 14 Nov 2015 - 11:19 |
| WebFilter | 4+2 | 34.42 KB | 13 Nov 2015 - 11:29 |
| Unknown robot (identified by '*bot') | 3+4 | 2.13 MB | 09 Nov 2015 - 03:55 |
| Phantom | 1 | 39.71 KB | 09 Nov 2015 - 01:17 |
| Y!J Yahoo Japan | 1+1 | 8.65 KB | 08 Nov 2015 - 03:04 |
| TITAN | 2 | 1.16 MB | 07 Nov 2015 - 18:14 |
| Netcraft | 5 | 25.69 KB | 07 Nov 2015 - 12:37 |