53 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 49723+789 | 9.15 GB | 30 Apr 2014 - 23:59 |
Googlebot | 29581+733 | 18.07 GB | 30 Apr 2014 - 23:57 |
Unknown robot (identified by 'crawl') | 17664+97 | 310.89 MB | 30 Apr 2014 - 23:21 |
Yahoo Slurp | 8367+30 | 1.75 GB | 30 Apr 2014 - 23:58 |
Yandex bot | 6483+51 | 3.56 GB | 30 Apr 2014 - 16:39 |
Java (Often spam bot) | 2003+16 | 139.59 MB | 30 Apr 2014 - 20:39 |
Unknown robot (identified by empty user agent string) | 1499+32 | 189.84 MB | 30 Apr 2014 - 17:22 |
psbot | 1267+45 | 21.66 MB | 30 Apr 2014 - 23:08 |
Unknown robot (identified by hit on 'robots.txt') | 0+1125 | 97.78 KB | 30 Apr 2014 - 19:47 |
Sogou Spider | 643+42 | 326.89 MB | 30 Apr 2014 - 15:19 |
Mail.ru bot | 495+140 | 15.05 MB | 28 Apr 2014 - 22:44 |
Unknown robot (identified by 'spider') | 392+69 | 66.71 MB | 30 Apr 2014 - 21:01 |
Unknown robot (identified by 'robot') | 260+38 | 268.09 MB | 30 Apr 2014 - 03:48 |
Feedfetcher-Google | 295 | 6.70 MB | 30 Apr 2014 - 23:17 |
MJ12bot | 197+28 | 19.59 MB | 29 Apr 2014 - 02:37 |
MagpieRSS | 173+34 | 1.42 MB | 30 Apr 2014 - 23:02 |
BaiDuSpider | 176+3 | 45.97 MB | 30 Apr 2014 - 22:07 |
FaceBook bot | 108 | 9.78 MB | 30 Apr 2014 - 16:55 |
Exabot | 81+27 | 3.93 MB | 29 Apr 2014 - 08:48 |
WordPress | 101 | 9.69 MB | 29 Apr 2014 - 22:26 |
Harvest | 94 | 6.94 MB | 29 Apr 2014 - 18:14 |
SeznamBot | 72+17 | 103.84 MB | 30 Apr 2014 - 12:57 |
Jakarta commons-httpclient | 79+2 | 20.56 MB | 30 Apr 2014 - 09:48 |
yacy | 50+11 | 10.80 MB | 25 Apr 2014 - 23:46 |
archive.org bot | 42+18 | 73.16 MB | 29 Apr 2014 - 23:55 |
FavIconizer | 58 | 738.85 KB | 30 Apr 2014 - 08:52 |
MSNBot | 41+12 | 14.78 MB | 29 Apr 2014 - 01:21 |
WGet tools | 39 | 138.73 MB | 29 Apr 2014 - 08:11 |
CFNetwork | 34 | 7.08 MB | 21 Apr 2014 - 17:45 |
Python-urllib | 28+6 | 33.10 MB | 28 Apr 2014 - 10:31 |
LinkChecker | 33 | 4.47 MB | 30 Apr 2014 - 07:15 |
MSIECrawler | 18+7 | 3.03 MB | 26 Apr 2014 - 03:38 |
Nutch | 10+10 | 2.13 MB | 29 Apr 2014 - 03:22 |
MSNBot-media | 7+12 | 123.01 KB | 30 Apr 2014 - 18:54 |
WebFilter | 6+4 | 71.31 KB | 27 Apr 2014 - 07:11 |
Perl tool | 8 | 1.64 MB | 29 Apr 2014 - 02:44 |
Turn It In | 3+4 | 1.31 MB | 22 Apr 2014 - 00:21 |
Alexa (IA Archiver) | 7 | 657.24 KB | 03 Apr 2014 - 03:25 |
Unknown robot (identified by 'checker') | 7 | 4.19 MB | 18 Apr 2014 - 23:25 |
Heritrix | 3+3 | 20.34 MB | 29 Apr 2014 - 12:55 |
larbin | 2+3 | 24.29 KB | 02 Apr 2014 - 04:14 |
Vagabondo | 3 | 48.30 KB | 08 Apr 2014 - 20:19 |
Unknown robot (identified by '*bot') | 0+3 | 267 Bytes | 17 Apr 2014 - 23:58 |
DoCoMo | 1+1 | 16.97 KB | 11 Apr 2014 - 07:00 |
MojeekBot | 1+1 | 93.98 KB | 01 Apr 2014 - 22:35 |
W3C Link Checker | 1+1 | 89 Bytes | 22 Apr 2014 - 21:58 |
HTTrack off-line browser | 2 | 10.00 MB | 19 Apr 2014 - 21:27 |
the World Wide Web Wanderer | 2 | 8.38 KB | 17 Apr 2014 - 12:40 |
Netcraft | 2 | 8.38 KB | 11 Apr 2014 - 05:31 |
HTMLParser | 1 | 3.56 MB | 20 Apr 2014 - 18:38 |
Netluchs | 0+1 | 89 Bytes | 07 Apr 2014 - 07:38 |
VSE | 0+1 | 89 Bytes | 28 Apr 2014 - 07:20 |
W3C Validator | 1 | 8.38 KB | 15 Apr 2014 - 09:00 |