| 51 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 34366+1014 | 10.77 GB | 31 Jul 2016 - 23:59 |
| BaiDuSpider | 14022+20 | 4.68 GB | 31 Jul 2016 - 23:57 |
| Yahoo Slurp | 26049+81 | 2.66 GB | 31 Jul 2016 - 23:56 |
| Googlebot | 49842+1149 | 36.91 GB | 31 Jul 2016 - 23:55 |
| Unknown robot (identified by 'robot') | 87+209 | 34.76 MB | 31 Jul 2016 - 23:29 |
| MagpieRSS | 145 | 1.21 MB | 31 Jul 2016 - 23:29 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1602 | 139.52 KB | 31 Jul 2016 - 22:52 |
| Yandex bot | 10094+92 | 2.17 GB | 31 Jul 2016 - 22:47 |
| Unknown robot (identified by 'crawl') | 61471+152 | 1.21 GB | 31 Jul 2016 - 22:18 |
| Sogou Spider | 95+43 | 37.08 MB | 31 Jul 2016 - 21:48 |
| MSNBot-media | 39 | 2.72 MB | 31 Jul 2016 - 21:09 |
| Java (Often spam bot) | 421+2 | 30.90 MB | 31 Jul 2016 - 20:39 |
| SeznamBot | 14+39 | 54.69 KB | 31 Jul 2016 - 19:38 |
| Harvest | 42 | 110.03 KB | 31 Jul 2016 - 19:26 |
| Unknown robot (identified by empty user agent string) | 1746+18 | 380.42 MB | 31 Jul 2016 - 19:25 |
| FavIconizer | 231 | 7.73 MB | 31 Jul 2016 - 15:14 |
| psbot | 482+15 | 7.54 MB | 31 Jul 2016 - 13:45 |
| MJ12bot | 188+19 | 19.34 MB | 31 Jul 2016 - 13:13 |
| archive.org bot | 6+11 | 15.72 MB | 31 Jul 2016 - 11:13 |
| Unknown robot (identified by 'spider') | 45+10 | 8.73 MB | 31 Jul 2016 - 05:13 |
| Feedfetcher-Google | 62 | 1.62 MB | 31 Jul 2016 - 03:31 |
| yacy | 329+14 | 74.50 MB | 31 Jul 2016 - 00:46 |
| LinkChecker | 25 | 3.39 MB | 30 Jul 2016 - 22:15 |
| Turn It In | 5+5 | 4.54 MB | 30 Jul 2016 - 18:44 |
| Exabot | 27+12 | 1.15 MB | 30 Jul 2016 - 18:34 |
| WebFilter | 1+1 | 16.42 KB | 30 Jul 2016 - 17:34 |
| Alexa (IA Archiver) | 22+25 | 4.04 MB | 30 Jul 2016 - 16:55 |
| WordPress | 278 | 30.50 MB | 30 Jul 2016 - 16:00 |
| CFNetwork | 51 | 10.25 MB | 30 Jul 2016 - 12:51 |
| Heritrix | 6+2 | 640.88 KB | 30 Jul 2016 - 12:17 |
| Python-urllib | 303+2 | 81.01 MB | 30 Jul 2016 - 09:22 |
| Unknown robot (identified by 'checker') | 16 | 0 | 29 Jul 2016 - 22:28 |
| Web Core / Roots | 20 | 1.48 MB | 29 Jul 2016 - 20:36 |
| FaceBook bot | 48 | 3.43 MB | 29 Jul 2016 - 09:51 |
| Mail.ru bot | 287+77 | 110.84 MB | 29 Jul 2016 - 07:08 |
| Perl tool | 23 | 130.47 KB | 28 Jul 2016 - 23:22 |
| Jakarta commons-httpclient | 23 | 8.75 MB | 28 Jul 2016 - 01:13 |
| LinkWalker | 0+1 | 89 Bytes | 26 Jul 2016 - 06:43 |
| Nutch | 25+33 | 10.27 MB | 26 Jul 2016 - 05:23 |
| WGet tools | 57 | 43.84 MB | 24 Jul 2016 - 16:29 |
| Powermarks | 2 | 36.95 KB | 24 Jul 2016 - 02:12 |
| MSIECrawler | 1 | 18.47 KB | 23 Jul 2016 - 20:53 |
| TITAN | 2 | 1.06 MB | 22 Jul 2016 - 08:47 |
| Sift | 9 | 145.45 KB | 22 Jul 2016 - 05:01 |
| HTTrack off-line browser | 6 | 8.10 MB | 21 Jul 2016 - 16:28 |
| NG 1.x (Exalead) | 1 | 1.79 MB | 19 Jul 2016 - 07:59 |
| Phantom | 3 | 1.19 MB | 16 Jul 2016 - 07:02 |
| MSNBot | 2 | 24.56 KB | 15 Jul 2016 - 15:31 |
| Netcraft | 2 | 8.56 KB | 14 Jul 2016 - 09:10 |
| SpiderBot | 0+1 | 89 Bytes | 06 Jul 2016 - 08:54 |
| Custo | 0+2 | 178 Bytes | 03 Jul 2016 - 22:24 |