| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 36553+732 | 19.71 GB | 31 May 2014 - 23:59 |
| Yahoo Slurp | 11710+35 | 2.61 GB | 31 May 2014 - 23:57 |
| Unknown robot (identified by 'bot*') | 58334+474 | 6.00 GB | 31 May 2014 - 23:57 |
| Yandex bot | 10047+48 | 3.94 GB | 31 May 2014 - 23:56 |
| BaiDuSpider | 1655+1 | 210.29 MB | 31 May 2014 - 23:30 |
| Feedfetcher-Google | 510 | 13.24 MB | 31 May 2014 - 23:23 |
| HTTrack off-line browser | 15 | 8.80 MB | 31 May 2014 - 23:20 |
| MagpieRSS | 167+35 | 1.37 MB | 31 May 2014 - 23:18 |
| Unknown robot (identified by hit on 'robots.txt') | 0+4973 | 432.22 KB | 31 May 2014 - 23:08 |
| Unknown robot (identified by 'robot') | 333+49 | 300.11 MB | 31 May 2014 - 22:42 |
| Java (Often spam bot) | 7686+22 | 543.32 MB | 31 May 2014 - 21:03 |
| Unknown robot (identified by empty user agent string) | 809+32 | 199.29 MB | 31 May 2014 - 20:38 |
| Unknown robot (identified by 'spider') | 310+95 | 51.01 MB | 31 May 2014 - 20:11 |
| MSNBot-media | 25+23 | 203.70 KB | 31 May 2014 - 19:17 |
| Python-urllib | 325+5 | 11.02 MB | 31 May 2014 - 18:19 |
| Exabot | 59+29 | 2.26 MB | 31 May 2014 - 18:13 |
| WGet tools | 26 | 43.55 MB | 31 May 2014 - 17:22 |
| CFNetwork | 15 | 22.02 MB | 31 May 2014 - 17:08 |
| Sven | 1+1 | 1.21 MB | 31 May 2014 - 16:51 |
| Mail.ru bot | 191+55 | 15.48 MB | 31 May 2014 - 15:37 |
| W3C Link Checker | 2+2 | 178 Bytes | 31 May 2014 - 14:57 |
| MJ12bot | 26+19 | 1.51 MB | 31 May 2014 - 14:39 |
| LinkChecker | 35 | 4.74 MB | 31 May 2014 - 11:52 |
| yacy | 115+11 | 21.22 MB | 31 May 2014 - 09:10 |
| Sogou Spider | 569+43 | 218.71 MB | 31 May 2014 - 07:24 |
| Unknown robot (identified by 'crawl') | 69+58 | 23.61 MB | 31 May 2014 - 03:56 |
| SeznamBot | 43+21 | 27.71 MB | 31 May 2014 - 00:22 |
| WordPress | 177 | 44.64 MB | 30 May 2014 - 22:48 |
| WebFilter | 22+14 | 177.17 KB | 30 May 2014 - 19:11 |
| Harvest | 56 | 163.64 KB | 30 May 2014 - 16:34 |
| FavIconizer | 48 | 860.14 KB | 30 May 2014 - 14:40 |
| Phantom | 37 | 3.27 MB | 30 May 2014 - 08:59 |
| Perl tool | 13 | 221.78 KB | 30 May 2014 - 01:58 |
| MSNBot | 20+11 | 6.95 MB | 30 May 2014 - 00:50 |
| archive.org bot | 3+18 | 6.95 MB | 29 May 2014 - 23:29 |
| Jakarta commons-httpclient | 52+1 | 5.90 MB | 29 May 2014 - 11:06 |
| MSIECrawler | 39+7 | 11.44 MB | 29 May 2014 - 08:43 |
| Google AdSense | 1 | 37.45 KB | 29 May 2014 - 00:34 |
| Nutch | 4+4 | 126.64 KB | 28 May 2014 - 21:03 |
| psbot | 401+19 | 14.79 MB | 28 May 2014 - 13:45 |
| FaceBook bot | 69 | 6.76 MB | 28 May 2014 - 13:33 |
| Web Core / Roots | 2+3 | 846.20 KB | 28 May 2014 - 13:16 |
| the World Wide Web Wanderer | 5 | 14.68 KB | 28 May 2014 - 11:22 |
| VSE | 0+2 | 178 Bytes | 28 May 2014 - 10:45 |
| MojeekBot | 0+1 | 89 Bytes | 26 May 2014 - 16:01 |
| Unknown robot (identified by 'checker') | 1 | 2.77 MB | 26 May 2014 - 03:45 |
| larbin | 2+2 | 2.06 MB | 21 May 2014 - 19:18 |
| Turn It In | 2+2 | 9.42 MB | 21 May 2014 - 19:03 |
| DoCoMo | 2+2 | 25.44 KB | 21 May 2014 - 14:45 |
| TITAN | 1 | 102.68 KB | 19 May 2014 - 10:30 |
| Heritrix | 1321+2 | 81.97 MB | 18 May 2014 - 11:27 |
| BSpider | 1 | 1.21 MB | 17 May 2014 - 11:52 |
| Netcraft | 2 | 8.38 KB | 15 May 2014 - 12:06 |
| Raven Search | 1 | 0 | 14 May 2014 - 15:55 |
| Unknown robot (identified by '*bot') | 21 | 1.20 MB | 14 May 2014 - 01:43 |
| NG 1.x (Exalead) | 1 | 422.97 KB | 13 May 2014 - 13:29 |
| Custo | 1+1 | 1.21 MB | 11 May 2014 - 01:42 |
| Alexa (IA Archiver) | 1+1 | 16.97 KB | 07 May 2014 - 07:07 |
| LinkScan | 2 | 20.05 KB | 06 May 2014 - 09:44 |