61 different robots | Hits | Bandwidth | Last visit |
Googlebot | 50491+851 | 56.41 GB | 31 Mar 2017 - 23:59 |
Yandex bot | 36474+102 | 9.24 GB | 31 Mar 2017 - 23:03 |
Unknown robot (identified by 'bot*') | 34794+901 | 9.69 GB | 31 Mar 2017 - 23:59 |
Unknown robot (identified by 'crawl') | 34094+180 | 792.95 MB | 31 Mar 2017 - 23:10 |
Yahoo Slurp | 19437+59 | 1.96 GB | 31 Mar 2017 - 22:20 |
BaiDuSpider | 11309+17 | 1.17 GB | 31 Mar 2017 - 23:56 |
UniversalFeedParser | 4164 | 50.33 MB | 31 Mar 2017 - 21:51 |
psbot | 2233+64 | 35.13 MB | 22 Mar 2017 - 06:22 |
Java (Often spam bot) | 2019+2 | 5.36 GB | 31 Mar 2017 - 23:26 |
Sogou Spider | 1399+133 | 351.35 MB | 31 Mar 2017 - 23:11 |
Unknown robot (identified by hit on 'robots.txt') | 0+1525 | 132.54 KB | 31 Mar 2017 - 23:32 |
Unknown robot (identified by empty user agent string) | 571+13 | 163.30 MB | 31 Mar 2017 - 20:07 |
Exabot | 410+30 | 102.74 MB | 31 Mar 2017 - 14:12 |
MSNBot-media | 403 | 18.31 MB | 31 Mar 2017 - 19:10 |
FavIconizer | 317 | 69.04 MB | 31 Mar 2017 - 19:34 |
Unknown robot (identified by 'robot') | 112+129 | 13.07 MB | 31 Mar 2017 - 23:48 |
Unknown robot (identified by '*bot') | 133+19 | 59.86 MB | 31 Mar 2017 - 11:50 |
yacy | 120+24 | 60.33 MB | 28 Mar 2017 - 00:27 |
MJ12bot | 68+44 | 1.60 MB | 31 Mar 2017 - 06:44 |
SeznamBot | 43+65 | 38.50 MB | 31 Mar 2017 - 23:07 |
WordPress | 106 | 8.14 MB | 30 Mar 2017 - 14:01 |
MagpieRSS | 93 | 796.31 KB | 31 Mar 2017 - 23:48 |
Web Core / Roots | 78 | 9.86 MB | 31 Mar 2017 - 17:59 |
archive.org bot | 51+26 | 7.76 MB | 31 Mar 2017 - 17:57 |
FaceBook bot | 70 | 2.99 MB | 31 Mar 2017 - 15:55 |
Nutch | 33+36 | 18.75 MB | 28 Mar 2017 - 14:33 |
Alexa (IA Archiver) | 31+36 | 16.44 MB | 31 Mar 2017 - 23:11 |
Python-urllib | 60+2 | 23.89 MB | 31 Mar 2017 - 23:31 |
Unknown robot (identified by 'spider') | 36+14 | 12.84 MB | 31 Mar 2017 - 22:05 |
Harvest | 40 | 105.48 KB | 31 Mar 2017 - 15:45 |
WGet tools | 33+3 | 8.24 MB | 31 Mar 2017 - 07:28 |
Turn It In | 18+16 | 36.44 MB | 31 Mar 2017 - 15:40 |
Feedburner | 32 | 0 | 15 Mar 2017 - 18:14 |
Feedfetcher-Google | 31 | 935.93 KB | 31 Mar 2017 - 23:08 |
Phantom | 29 | 5.85 MB | 30 Mar 2017 - 00:45 |
CFNetwork | 29 | 7.99 MB | 30 Mar 2017 - 02:19 |
LinkChecker | 23 | 3.12 MB | 31 Mar 2017 - 07:22 |
fido | 18 | 544.00 KB | 31 Mar 2017 - 16:06 |
Perl tool | 17 | 2.21 MB | 30 Mar 2017 - 23:13 |
Mail.ru bot | 8+7 | 8.49 MB | 06 Mar 2017 - 08:37 |
WebFilter | 5+4 | 57.87 KB | 15 Mar 2017 - 06:22 |
HTTrack off-line browser | 7 | 13.09 MB | 29 Mar 2017 - 12:22 |
Jakarta commons-httpclient | 6 | 197.82 KB | 31 Mar 2017 - 04:40 |
ASpider (Associative Spider) | 3+3 | 3.64 MB | 15 Mar 2017 - 14:03 |
MojeekBot | 3+3 | 84.09 KB | 29 Mar 2017 - 01:16 |
Sunrise | 5 | 170.29 KB | 28 Mar 2017 - 15:46 |
Sift | 5 | 115.03 KB | 18 Mar 2017 - 21:35 |
W3C Link Checker | 2+2 | 178 Bytes | 30 Mar 2017 - 14:35 |
GigaBot | 2+2 | 100.90 KB | 24 Mar 2017 - 21:54 |
Custo | 3 | 46.52 KB | 30 Mar 2017 - 07:21 |
Heritrix | 1+2 | 1.79 MB | 03 Mar 2017 - 04:47 |
Unknown robot (identified by 'checker') | 2+1 | 46.10 KB | 28 Mar 2017 - 17:10 |
LinkBot | 2 | 17.76 KB | 13 Mar 2017 - 17:58 |
Emacs-w3 Search Engine | 2 | 73.17 KB | 23 Mar 2017 - 20:37 |
larbin | 1+1 | 36.67 KB | 03 Mar 2017 - 07:09 |
Netcraft | 2 | 8.56 KB | 09 Mar 2017 - 00:40 |
Powermarks | 1 | 37.45 KB | 29 Mar 2017 - 00:50 |
LinkWalker | 0+1 | 89 Bytes | 31 Mar 2017 - 09:49 |
Calif | 1 | 327.12 KB | 21 Mar 2017 - 17:04 |
marvin/infoseek | 1 | 36.58 KB | 17 Mar 2017 - 23:15 |
Spiderman | 1 | 8.56 KB | 02 Mar 2017 - 18:20 |