54 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 1140783+39140 | 13.99 GB | 30 Jun 2012 - 23:57 |
Googlebot | 49075+36 | 28.78 GB | 30 Jun 2012 - 23:59 |
Yandex bot | 38153+38 | 10.08 GB | 30 Jun 2012 - 23:58 |
Unknown robot (identified by 'bot*') | 29224+207 | 13.31 GB | 30 Jun 2012 - 23:58 |
BaiDuSpider | 7960+88 | 148.21 MB | 30 Jun 2012 - 23:59 |
Unknown robot (identified by hit on 'robots.txt') | 0+1168 | 35.36 KB | 30 Jun 2012 - 23:33 |
Unknown robot (identified by empty user agent string) | 970+18 | 541.92 MB | 30 Jun 2012 - 19:47 |
Unknown robot (identified by 'spider') | 701+16 | 273.91 MB | 30 Jun 2012 - 19:38 |
Sogou Spider | 681+10 | 215.96 MB | 30 Jun 2012 - 23:58 |
Unknown robot (identified by 'robot') | 433+28 | 174.47 MB | 30 Jun 2012 - 23:45 |
yacy | 399+2 | 60.58 MB | 28 Jun 2012 - 11:15 |
Jakarta commons-httpclient | 309 | 3.30 MB | 30 Jun 2012 - 10:07 |
Feedfetcher-Google | 273 | 17.76 MB | 30 Jun 2012 - 21:36 |
Unknown robot (identified by 'discovery') | 142+15 | 144.20 MB | 30 Jun 2012 - 21:57 |
Yahoo Slurp | 128+20 | 82.95 MB | 30 Jun 2012 - 16:54 |
FaceBook bot | 145 | 6.34 MB | 30 Jun 2012 - 07:23 |
MagpieRSS | 123+14 | 866.95 KB | 30 Jun 2012 - 11:14 |
legs | 70+38 | 74.70 MB | 29 Jun 2012 - 21:38 |
BSpider | 89+16 | 6.36 MB | 30 Jun 2012 - 19:23 |
WordPress | 104 | 12.42 MB | 30 Jun 2012 - 14:15 |
Java (Often spam bot) | 87+2 | 4.58 MB | 28 Jun 2012 - 08:39 |
MSNBot-media | 43+20 | 1.46 MB | 26 Jun 2012 - 01:40 |
Nutch | 34+26 | 17.14 MB | 30 Jun 2012 - 01:59 |
Alexa (IA Archiver) | 27+30 | 724.53 KB | 30 Jun 2012 - 06:05 |
MSNBot | 41+15 | 5.90 MB | 29 Jun 2012 - 18:54 |
Harvest | 56 | 227.04 KB | 29 Jun 2012 - 16:19 |
CFNetwork | 48 | 18.44 MB | 27 Jun 2012 - 00:17 |
OutfoxBot/YodaoBot | 44 | 309.98 KB | 24 Jun 2012 - 23:28 |
Python-urllib | 41+3 | 28.00 MB | 27 Jun 2012 - 22:20 |
Exabot | 29+13 | 435.11 KB | 29 Jun 2012 - 09:54 |
MJ12bot | 18+22 | 479.18 KB | 29 Jun 2012 - 10:04 |
archive.org bot | 18+10 | 2.58 MB | 30 Jun 2012 - 02:59 |
WGet tools | 25+1 | 28.07 MB | 28 Jun 2012 - 08:38 |
Perl tool | 22 | 8.85 MB | 28 Jun 2012 - 16:22 |
Mail.ru bot | 13+6 | 16.61 MB | 30 Jun 2012 - 12:47 |
Unknown robot (identified by '*bot') | 7+10 | 194.54 KB | 30 Jun 2012 - 23:38 |
SeznamBot | 5+6 | 1.40 MB | 26 Jun 2012 - 08:07 |
Powermarks | 10 | 2.86 MB | 28 Jun 2012 - 05:40 |
HTTrack off-line browser | 9+1 | 3.27 MB | 20 Jun 2012 - 01:39 |
NG 1.x (Exalead) | 9 | 8.22 MB | 16 Jun 2012 - 20:05 |
bender focused_crawler | 6+3 | 25.16 MB | 16 Jun 2012 - 08:12 |
Turn It In | 1+5 | 1.21 MB | 06 Jun 2012 - 16:47 |
DoCoMo | 3+3 | 65.45 KB | 16 Jun 2012 - 14:36 |
Web Core / Roots | 6 | 60.58 KB | 11 Jun 2012 - 23:52 |
Heritrix | 3+2 | 3.00 MB | 24 Jun 2012 - 03:06 |
Netluchs | 1+1 | 1.77 MB | 22 Jun 2012 - 20:57 |
Voila | 0+2 | 62 Bytes | 30 Jun 2012 - 14:18 |
Y!J Yahoo Japan | 1+1 | 141.08 KB | 27 Jun 2012 - 01:14 |
Motor | 2 | 190.81 KB | 02 Jun 2012 - 07:17 |
Netcraft | 2 | 7.04 KB | 02 Jun 2012 - 17:30 |
UCSD Crawl | 1 | 2.62 MB | 12 Jun 2012 - 03:01 |
FavIconizer | 1 | 7.04 KB | 09 Jun 2012 - 02:33 |
WebFilter | 1 | 12.84 KB | 29 Jun 2012 - 20:28 |
MSIECrawler | 0+1 | 31 Bytes | 22 Jun 2012 - 07:19 |
Others | 0 | 0 | |