52 different robots | Hits | Bandwidth | Last visit |
Googlebot | 42213+720 | 21.47 GB | 31 Jan 2014 - 23:58 |
Unknown robot (identified by 'bot*') | 32609+672 | 6.98 GB | 31 Jan 2014 - 23:58 |
Java (Often spam bot) | 29624+4 | 48.84 MB | 31 Jan 2014 - 20:39 |
Yandex bot | 5603+65 | 4.29 GB | 31 Jan 2014 - 23:59 |
Unknown robot (identified by 'crawl') | 4858+41 | 45.75 MB | 30 Jan 2014 - 23:33 |
BaiDuSpider | 3027 | 215.96 MB | 31 Jan 2014 - 23:49 |
Mail.ru bot | 1652+217 | 589.64 MB | 31 Jan 2014 - 23:57 |
Heritrix | 1586+2 | 84.19 MB | 14 Jan 2014 - 15:57 |
Unknown robot (identified by hit on 'robots.txt') | 0+815 | 70.83 KB | 31 Jan 2014 - 21:50 |
Sogou Spider | 636+40 | 305.99 MB | 31 Jan 2014 - 22:38 |
Unknown robot (identified by empty user agent string) | 427+29 | 96.21 MB | 31 Jan 2014 - 21:52 |
Python-urllib | 327+2 | 12.11 MB | 29 Jan 2014 - 03:42 |
psbot | 281+25 | 5.61 MB | 31 Jan 2014 - 19:58 |
Feedfetcher-Google | 292 | 6.65 MB | 31 Jan 2014 - 20:28 |
Yahoo Slurp | 227+44 | 89.21 MB | 31 Jan 2014 - 23:07 |
SeznamBot | 243+16 | 60.02 MB | 30 Jan 2014 - 04:56 |
Unknown robot (identified by 'spider') | 207+36 | 29.10 MB | 31 Jan 2014 - 17:37 |
MSNBot | 191+32 | 19.99 MB | 31 Jan 2014 - 13:12 |
MagpieRSS | 156+38 | 1.28 MB | 31 Jan 2014 - 20:52 |
MJ12bot | 97+16 | 9.09 MB | 30 Jan 2014 - 09:06 |
WordPress | 87 | 8.07 MB | 30 Jan 2014 - 19:17 |
Jakarta commons-httpclient | 78 | 4.84 MB | 31 Jan 2014 - 19:37 |
yacy | 46+25 | 8.16 MB | 30 Jan 2014 - 02:19 |
Exabot | 56+12 | 1.85 MB | 30 Jan 2014 - 10:52 |
Harvest | 68 | 189.77 KB | 31 Jan 2014 - 16:32 |
Unknown robot (identified by '*bot') | 60+3 | 16.33 MB | 25 Jan 2014 - 12:06 |
FaceBook bot | 59 | 7.31 MB | 31 Jan 2014 - 23:59 |
FavIconizer | 56 | 852.13 KB | 30 Jan 2014 - 13:35 |
Unknown robot (identified by 'robot') | 32+10 | 13.74 MB | 31 Jan 2014 - 08:16 |
WebFilter | 20+16 | 160.08 KB | 31 Jan 2014 - 18:40 |
LinkChecker | 35 | 4.74 MB | 31 Jan 2014 - 19:19 |
MSNBot-media | 13+12 | 13.27 MB | 30 Jan 2014 - 23:32 |
Nutch | 12+12 | 3.99 MB | 30 Jan 2014 - 09:49 |
NG 1.x (Exalead) | 22 | 10.63 MB | 30 Jan 2014 - 23:20 |
MSIECrawler | 18+2 | 3.03 MB | 20 Jan 2014 - 08:36 |
archive.org bot | 3+11 | 2.09 MB | 30 Jan 2014 - 00:56 |
Unknown robot (identified by 'checker') | 11+2 | 89 Bytes | 14 Jan 2014 - 14:39 |
Perl tool | 10 | 771.66 KB | 25 Jan 2014 - 06:10 |
HTTrack off-line browser | 8 | 8.53 MB | 31 Jan 2014 - 18:55 |
legs | 4+1 | 33.60 KB | 22 Jan 2014 - 13:59 |
WGet tools | 4 | 5.47 MB | 28 Jan 2014 - 14:41 |
Phantom | 2 | 2.23 MB | 10 Jan 2014 - 17:29 |
CFNetwork | 2 | 4.28 MB | 28 Jan 2014 - 04:13 |
W3C Validator | 2 | 16.76 KB | 25 Jan 2014 - 17:47 |
BSpider | 1+1 | 8.47 KB | 06 Jan 2014 - 00:00 |
Alexa (IA Archiver) | 1+1 | 16.97 KB | 04 Jan 2014 - 13:21 |
Netcraft | 2 | 8.38 KB | 09 Jan 2014 - 11:18 |
Powermarks | 1 | 8.38 KB | 16 Jan 2014 - 15:41 |
HTMLParser | 1 | 1.09 MB | 22 Jan 2014 - 06:28 |
Unknown robot (identified by 'discovery') | 1 | 8.38 KB | 27 Jan 2014 - 03:17 |
Voila | 0+1 | 89 Bytes | 20 Jan 2014 - 07:57 |
lmspider | 0+1 | 89 Bytes | 08 Jan 2014 - 12:51 |