50 different robots | Hits | Bandwidth | Last visit |
BaiDuSpider | 9706+19 | 1.03 GB | 30 Nov 2016 - 23:59 |
Unknown robot (identified by 'bot*') | 24075+823 | 6.60 GB | 30 Nov 2016 - 23:56 |
Yahoo Slurp | 23645+56 | 1010.45 MB | 30 Nov 2016 - 23:54 |
Web Core / Roots | 1210353+6 | 37.85 GB | 30 Nov 2016 - 23:51 |
Googlebot | 52339+766 | 42.20 GB | 30 Nov 2016 - 23:49 |
Yandex bot | 3940+88 | 687.37 MB | 30 Nov 2016 - 23:40 |
Unknown robot (identified by 'robot') | 647+243 | 85.29 MB | 30 Nov 2016 - 23:25 |
MagpieRSS | 112 | 959.00 KB | 30 Nov 2016 - 23:15 |
Sogou Spider | 1040+384 | 67.09 MB | 30 Nov 2016 - 22:47 |
MSNBot-media | 119 | 5.04 MB | 30 Nov 2016 - 21:40 |
Feedfetcher-Google | 22 | 520.51 KB | 30 Nov 2016 - 21:38 |
Unknown robot (identified by 'crawl') | 27586+76 | 767.53 MB | 30 Nov 2016 - 21:17 |
Unknown robot (identified by 'spider') | 33+5 | 8.26 MB | 30 Nov 2016 - 21:12 |
Java (Often spam bot) | 560+2 | 27.17 MB | 30 Nov 2016 - 20:39 |
Perl tool | 11 | 81.96 KB | 30 Nov 2016 - 19:53 |
Nutch | 11+10 | 4.85 MB | 30 Nov 2016 - 19:51 |
Unknown robot (identified by hit on 'robots.txt') | 0+410 | 35.63 KB | 30 Nov 2016 - 19:06 |
Google AdSense | 551 | 7.24 MB | 30 Nov 2016 - 18:54 |
CFNetwork | 21 | 37.19 MB | 30 Nov 2016 - 17:06 |
Unknown robot (identified by empty user agent string) | 2063+9 | 331.25 MB | 30 Nov 2016 - 15:40 |
Heritrix | 83+2 | 35.99 MB | 30 Nov 2016 - 14:37 |
FavIconizer | 250 | 48.53 MB | 30 Nov 2016 - 13:22 |
WGet tools | 21+2 | 437.72 MB | 30 Nov 2016 - 12:39 |
UniversalFeedParser | 162 | 2.12 MB | 30 Nov 2016 - 10:50 |
SeznamBot | 38+62 | 25.80 MB | 30 Nov 2016 - 06:50 |
Sift | 9 | 144.49 KB | 30 Nov 2016 - 06:40 |
psbot | 2693+83 | 42.32 MB | 30 Nov 2016 - 06:26 |
archive.org bot | 8+19 | 5.68 MB | 30 Nov 2016 - 05:04 |
MJ12bot | 73+54 | 2.10 MB | 30 Nov 2016 - 01:51 |
LinkChecker | 24+2 | 3.25 MB | 29 Nov 2016 - 23:44 |
WordPress | 283 | 43.81 MB | 29 Nov 2016 - 23:17 |
FaceBook bot | 38 | 8.61 MB | 29 Nov 2016 - 20:30 |
Python-urllib | 180 | 11.80 MB | 29 Nov 2016 - 09:39 |
HTTrack off-line browser | 16 | 22.41 MB | 29 Nov 2016 - 01:56 |
yacy | 160+14 | 69.94 MB | 28 Nov 2016 - 08:31 |
TITAN | 1 | 613.63 KB | 28 Nov 2016 - 04:25 |
Harvest | 165 | 19.49 MB | 26 Nov 2016 - 21:33 |
Jakarta commons-httpclient | 25 | 1.69 MB | 25 Nov 2016 - 22:50 |
Unknown robot (identified by 'checker') | 15 | 0 | 25 Nov 2016 - 19:26 |
Exabot | 80+16 | 354.18 KB | 23 Nov 2016 - 15:29 |
Alexa (IA Archiver) | 27+20 | 3.45 MB | 23 Nov 2016 - 03:43 |
NG 1.x (Exalead) | 2 | 1.10 MB | 22 Nov 2016 - 03:06 |
Turn It In | 12+12 | 11.62 MB | 20 Nov 2016 - 07:53 |
Spiderman | 5 | 42.81 KB | 19 Nov 2016 - 14:34 |
WebFilter | 1+1 | 64.23 KB | 18 Nov 2016 - 09:34 |
Unknown robot (identified by '*bot') | 0+1 | 89 Bytes | 17 Nov 2016 - 18:46 |
Phantom | 2 | 187.78 KB | 15 Nov 2016 - 08:34 |
W3C Link Checker | 1+1 | 89 Bytes | 13 Nov 2016 - 10:01 |
MojeekBot | 2+2 | 32.14 KB | 09 Nov 2016 - 08:20 |
LinkBot | 1 | 8.93 KB | 02 Nov 2016 - 09:21 |