| 51 different robots | Hits | Bandwidth | Last visit |
|---|
| BaiDuSpider | 15006+14 | 3.65 GB | 31 Aug 2016 - 23:59 |
| Yahoo Slurp | 25665+83 | 1.25 GB | 31 Aug 2016 - 23:58 |
| Unknown robot (identified by 'bot*') | 44011+13652 | 31.29 GB | 31 Aug 2016 - 23:57 |
| Googlebot | 48929+730 | 27.73 GB | 31 Aug 2016 - 23:57 |
| MSNBot-media | 397 | 6.56 MB | 31 Aug 2016 - 23:51 |
| Unknown robot (identified by 'robot') | 106+195 | 38.59 MB | 31 Aug 2016 - 23:44 |
| Yandex bot | 5659+92 | 2.54 GB | 31 Aug 2016 - 23:37 |
| Unknown robot (identified by hit on 'robots.txt') | 0+394 | 34.24 KB | 31 Aug 2016 - 22:50 |
| Feedfetcher-Google | 224 | 7.58 MB | 31 Aug 2016 - 22:47 |
| Unknown robot (identified by 'crawl') | 35827+156 | 1.18 GB | 31 Aug 2016 - 22:38 |
| WordPress | 336 | 31.54 MB | 31 Aug 2016 - 22:33 |
| Unknown robot (identified by 'spider') | 234+2 | 7.71 MB | 31 Aug 2016 - 22:17 |
| FavIconizer | 227 | 12.11 MB | 31 Aug 2016 - 21:40 |
| Java (Often spam bot) | 606+1 | 40.48 MB | 31 Aug 2016 - 21:31 |
| Perl tool | 16 | 3.16 MB | 31 Aug 2016 - 19:58 |
| FaceBook bot | 40 | 5.81 MB | 31 Aug 2016 - 19:17 |
| MagpieRSS | 128 | 1.07 MB | 31 Aug 2016 - 18:24 |
| yacy | 64+20 | 133.71 MB | 31 Aug 2016 - 17:29 |
| LinkChecker | 24 | 3.25 MB | 31 Aug 2016 - 17:23 |
| MJ12bot | 93+10 | 9.62 MB | 31 Aug 2016 - 16:34 |
| CFNetwork | 20 | 4.06 MB | 31 Aug 2016 - 16:23 |
| SeznamBot | 23+52 | 5.31 MB | 31 Aug 2016 - 14:57 |
| Unknown robot (identified by empty user agent string) | 177+25 | 65.63 MB | 31 Aug 2016 - 13:06 |
| Jakarta commons-httpclient | 26 | 19.11 MB | 31 Aug 2016 - 12:40 |
| Sogou Spider | 829+76 | 384.59 MB | 31 Aug 2016 - 10:24 |
| archive.org bot | 18+23 | 14.06 MB | 31 Aug 2016 - 08:30 |
| psbot | 2449+74 | 45.38 MB | 31 Aug 2016 - 06:41 |
| HTTrack off-line browser | 10 | 8.32 MB | 30 Aug 2016 - 22:32 |
| Python-urllib | 169+1 | 47.03 MB | 30 Aug 2016 - 16:11 |
| Kevin | 3 | 10.70 MB | 29 Aug 2016 - 06:06 |
| WGet tools | 51+8 | 57.73 MB | 28 Aug 2016 - 22:32 |
| Alexa (IA Archiver) | 42+27 | 25.46 MB | 28 Aug 2016 - 19:07 |
| UniversalFeedParser | 3525 | 32.51 MB | 28 Aug 2016 - 16:34 |
| Heritrix | 3017+38 | 28.50 MB | 28 Aug 2016 - 16:11 |
| MojeekBot | 2+2 | 72.88 KB | 28 Aug 2016 - 05:59 |
| Nutch | 4+9 | 542.60 KB | 27 Aug 2016 - 20:18 |
| Harvest | 89 | 6.93 MB | 27 Aug 2016 - 20:08 |
| Motor | 1 | 36.58 KB | 27 Aug 2016 - 17:26 |
| Exabot | 49+13 | 370.91 KB | 27 Aug 2016 - 12:18 |
| Unknown robot (identified by 'checker') | 18 | 0 | 26 Aug 2016 - 20:07 |
| Turn It In | 6+6 | 13.23 MB | 26 Aug 2016 - 14:42 |
| Web Core / Roots | 11 | 1.50 MB | 25 Aug 2016 - 11:52 |
| Phantom | 34 | 2.35 MB | 25 Aug 2016 - 02:54 |
| W3C Validator | 1 | 8.56 KB | 19 Aug 2016 - 16:41 |
| Sift | 6 | 96.36 KB | 19 Aug 2016 - 06:56 |
| MSNBot | 1 | 1.52 KB | 11 Aug 2016 - 17:38 |
| Powermarks | 2 | 1.13 MB | 11 Aug 2016 - 06:11 |
| Unknown robot (identified by 'discovery') | 1 | 0 | 10 Aug 2016 - 07:08 |
| Netcraft | 2 | 8.56 KB | 09 Aug 2016 - 21:05 |
| Raven Search | 1 | 0 | 02 Aug 2016 - 13:10 |
| WebFilter | 1+1 | 8.65 KB | 01 Aug 2016 - 19:53 |