53 different robots | Hits | Bandwidth | Last visit |
Googlebot | 26990+731 | 20.24 GB | 31 Jul 2015 - 23:59 |
Yahoo Slurp | 24102+33 | 3.81 GB | 31 Jul 2015 - 23:59 |
Yandex bot | 3498+123 | 834.58 MB | 31 Jul 2015 - 23:58 |
Unknown robot (identified by 'bot*') | 37335+584 | 12.70 GB | 31 Jul 2015 - 23:58 |
BaiDuSpider | 3162 | 728.80 MB | 31 Jul 2015 - 23:45 |
Unknown robot (identified by 'spider') | 518+21 | 28.41 MB | 31 Jul 2015 - 23:37 |
Exabot | 37+9 | 396.62 KB | 31 Jul 2015 - 23:05 |
Unknown robot (identified by 'crawl') | 43686+185 | 666.04 MB | 31 Jul 2015 - 22:48 |
LinkChecker | 37+1 | 5.01 MB | 31 Jul 2015 - 22:35 |
Unknown robot (identified by 'robot') | 43+197 | 21.02 MB | 31 Jul 2015 - 22:12 |
MagpieRSS | 178 | 1.49 MB | 31 Jul 2015 - 22:12 |
archive.org bot | 17+23 | 18.43 MB | 31 Jul 2015 - 21:15 |
Unknown robot (identified by hit on 'robots.txt') | 0+244 | 21.21 KB | 31 Jul 2015 - 21:11 |
Feedfetcher-Google | 78 | 18.85 MB | 31 Jul 2015 - 20:49 |
Java (Often spam bot) | 177+2 | 24.48 MB | 31 Jul 2015 - 20:39 |
Alexa (IA Archiver) | 3 | 139.91 KB | 31 Jul 2015 - 19:14 |
MSNBot | 5 | 1.48 MB | 31 Jul 2015 - 18:59 |
SeznamBot | 64+48 | 6.66 MB | 31 Jul 2015 - 17:12 |
Unknown robot (identified by empty user agent string) | 430+23 | 352.97 MB | 31 Jul 2015 - 16:20 |
Harvest | 38 | 108.64 KB | 31 Jul 2015 - 15:44 |
FavIconizer | 149 | 37.50 MB | 31 Jul 2015 - 15:34 |
Nutch | 141+50 | 184.28 MB | 31 Jul 2015 - 15:27 |
Sogou Spider | 642+46 | 247.59 MB | 31 Jul 2015 - 13:32 |
psbot | 101+3 | 1.58 MB | 31 Jul 2015 - 12:02 |
FaceBook bot | 147 | 2.91 MB | 31 Jul 2015 - 10:22 |
Jakarta commons-httpclient | 64 | 604.88 KB | 31 Jul 2015 - 10:09 |
yacy | 322+27 | 140.47 MB | 31 Jul 2015 - 01:12 |
Sift | 11 | 161.34 KB | 30 Jul 2015 - 23:20 |
WordPress | 132 | 26.82 MB | 30 Jul 2015 - 20:57 |
TITAN | 2 | 964.84 KB | 30 Jul 2015 - 07:57 |
Perl tool | 8 | 2.83 MB | 29 Jul 2015 - 22:24 |
Y!J Yahoo Japan | 5+5 | 43.25 KB | 29 Jul 2015 - 04:10 |
NG 2.x (Exalead) | 57 | 11.72 MB | 29 Jul 2015 - 00:58 |
Steeler | 38+6 | 6.92 MB | 29 Jul 2015 - 00:58 |
CFNetwork | 19 | 5.23 MB | 29 Jul 2015 - 00:06 |
BBot | 1 | 6.46 MB | 28 Jul 2015 - 06:25 |
Python-urllib | 982+3 | 26.09 MB | 28 Jul 2015 - 04:18 |
HTTrack off-line browser | 11 | 30.30 MB | 28 Jul 2015 - 01:47 |
MJ12bot | 2+4 | 17.47 KB | 27 Jul 2015 - 20:01 |
Phantom | 3 | 96.35 KB | 27 Jul 2015 - 08:32 |
Turn It In | 7+3 | 1.99 MB | 26 Jul 2015 - 18:05 |
Raven Search | 4 | 0 | 25 Jul 2015 - 04:01 |
WGet tools | 17 | 14.03 MB | 25 Jul 2015 - 03:30 |
Unknown robot (identified by 'discovery') | 3 | 1.77 MB | 24 Jul 2015 - 14:24 |
Heritrix | 25+1 | 118.75 MB | 23 Jul 2015 - 04:14 |
T-H-U-N-D-E-R-S-T-O-N-E | 18+2 | 780.55 KB | 22 Jul 2015 - 13:48 |
WebCollage | 1 | 51.39 KB | 21 Jul 2015 - 06:18 |
W3C Link Checker | 1+1 | 89 Bytes | 20 Jul 2015 - 15:40 |
Mail.ru bot | 69+31 | 28.69 MB | 18 Jul 2015 - 16:46 |
Web Core / Roots | 2 | 31.63 KB | 14 Jul 2015 - 18:44 |
Unknown robot (identified by '*bot') | 0+2 | 178 Bytes | 14 Jul 2015 - 14:53 |
Netcraft | 2 | 8.56 KB | 10 Jul 2015 - 10:23 |
SpiderBot | 1+1 | 1.79 MB | 09 Jul 2015 - 18:40 |