52 different robots | Hits | Bandwidth | Last visit |
Googlebot | 49345+679 | 57.69 GB | 28 Feb 2017 - 23:55 |
Yandex bot | 41879+96 | 10.17 GB | 28 Feb 2017 - 20:55 |
Unknown robot (identified by 'crawl') | 29717+70 | 651.93 MB | 28 Feb 2017 - 22:08 |
Unknown robot (identified by 'bot*') | 25282+506 | 5.79 GB | 28 Feb 2017 - 23:09 |
Yahoo Slurp | 21097+50 | 2.44 GB | 28 Feb 2017 - 23:59 |
BaiDuSpider | 9364+13 | 1013.82 MB | 28 Feb 2017 - 23:52 |
Web Core / Roots | 8176+2 | 16.82 GB | 28 Feb 2017 - 17:54 |
UniversalFeedParser | 4268 | 43.97 MB | 28 Feb 2017 - 23:15 |
Turn It In | 2581+12 | 76.96 MB | 27 Feb 2017 - 10:38 |
Unknown robot (identified by hit on 'robots.txt') | 0+1323 | 114.99 KB | 28 Feb 2017 - 22:22 |
Sogou Spider | 1238+58 | 273.11 MB | 28 Feb 2017 - 22:48 |
Java (Often spam bot) | 538+3 | 31.65 MB | 28 Feb 2017 - 23:05 |
psbot | 285+13 | 4.47 MB | 28 Feb 2017 - 13:37 |
Unknown robot (identified by empty user agent string) | 274+11 | 111.28 MB | 28 Feb 2017 - 15:16 |
FavIconizer | 258 | 25.82 MB | 28 Feb 2017 - 20:37 |
Unknown robot (identified by 'robot') | 63+93 | 16.96 MB | 28 Feb 2017 - 16:25 |
larbin | 133+4 | 17.84 MB | 13 Feb 2017 - 13:59 |
yacy | 118+17 | 51.85 MB | 28 Feb 2017 - 05:56 |
Exabot | 104+17 | 15.25 MB | 28 Feb 2017 - 14:57 |
WordPress | 107 | 17.69 MB | 24 Feb 2017 - 17:04 |
archive.org bot | 77+29 | 45.02 MB | 26 Feb 2017 - 00:59 |
SeznamBot | 35+64 | 42.32 MB | 28 Feb 2017 - 04:34 |
MJ12bot | 64+34 | 1.73 MB | 26 Feb 2017 - 11:11 |
Unknown robot (identified by '*bot') | 69+16 | 36.81 MB | 28 Feb 2017 - 10:04 |
Harvest | 85 | 6.94 MB | 27 Feb 2017 - 23:15 |
Python-urllib | 83+1 | 67.34 MB | 28 Feb 2017 - 06:28 |
MagpieRSS | 67 | 573.69 KB | 28 Feb 2017 - 16:25 |
Nutch | 29+22 | 12.52 MB | 28 Feb 2017 - 23:53 |
FaceBook bot | 44 | 3.93 MB | 28 Feb 2017 - 15:57 |
CFNetwork | 35 | 9.01 MB | 28 Feb 2017 - 07:08 |
Alexa (IA Archiver) | 16+19 | 31.70 MB | 28 Feb 2017 - 21:19 |
Feedfetcher-Google | 35 | 1001.40 KB | 28 Feb 2017 - 21:45 |
Unknown robot (identified by 'spider') | 27+6 | 1.68 MB | 28 Feb 2017 - 20:26 |
LinkChecker | 22 | 2.98 MB | 28 Feb 2017 - 22:12 |
Mail.ru bot | 7+9 | 3.44 MB | 08 Feb 2017 - 16:01 |
Perl tool | 14 | 6.18 MB | 19 Feb 2017 - 04:48 |
Jakarta commons-httpclient | 11 | 1.49 MB | 20 Feb 2017 - 10:03 |
WGet tools | 10+1 | 6.18 MB | 28 Feb 2017 - 15:57 |
HTTrack off-line browser | 9 | 13.55 MB | 26 Feb 2017 - 02:49 |
Sift | 8 | 172.51 KB | 28 Feb 2017 - 13:27 |
Custo | 7 | 558.86 KB | 21 Feb 2017 - 03:28 |
Phantom | 6 | 164.04 KB | 24 Feb 2017 - 16:45 |
LinkBot | 5 | 52.08 KB | 22 Feb 2017 - 22:34 |
MSNBot-media | 5 | 81.22 KB | 25 Feb 2017 - 22:12 |
Netcraft | 4 | 25.69 KB | 08 Feb 2017 - 12:40 |
Unknown robot (identified by 'checker') | 1+2 | 16.13 KB | 01 Feb 2017 - 09:47 |
TITAN | 2 | 597.87 KB | 26 Feb 2017 - 20:36 |
NG 1.x (Exalead) | 1 | 30.29 KB | 22 Feb 2017 - 11:53 |
HTMLParser | 1 | 8.56 KB | 22 Feb 2017 - 15:12 |
fido | 1 | 93.89 KB | 28 Feb 2017 - 11:57 |
ASpider (Associative Spider) | 0+1 | 89 Bytes | 15 Feb 2017 - 14:39 |
StackRambler | 1 | 1.47 MB | 22 Feb 2017 - 12:49 |