51 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 61471+152 | 1.21 GB | 31 Jul 2016 - 22:18 |
Googlebot | 49842+1149 | 36.91 GB | 31 Jul 2016 - 23:55 |
Unknown robot (identified by 'bot*') | 34366+1014 | 10.77 GB | 31 Jul 2016 - 23:59 |
Yahoo Slurp | 26049+81 | 2.66 GB | 31 Jul 2016 - 23:56 |
BaiDuSpider | 14022+20 | 4.68 GB | 31 Jul 2016 - 23:57 |
Yandex bot | 10094+92 | 2.17 GB | 31 Jul 2016 - 22:47 |
Unknown robot (identified by empty user agent string) | 1746+18 | 380.42 MB | 31 Jul 2016 - 19:25 |
Unknown robot (identified by hit on 'robots.txt') | 0+1602 | 139.52 KB | 31 Jul 2016 - 22:52 |
psbot | 482+15 | 7.54 MB | 31 Jul 2016 - 13:45 |
Java (Often spam bot) | 421+2 | 30.90 MB | 31 Jul 2016 - 20:39 |
Mail.ru bot | 287+77 | 110.84 MB | 29 Jul 2016 - 07:08 |
yacy | 329+14 | 74.50 MB | 31 Jul 2016 - 00:46 |
Python-urllib | 303+2 | 81.01 MB | 30 Jul 2016 - 09:22 |
Unknown robot (identified by 'robot') | 87+209 | 34.76 MB | 31 Jul 2016 - 23:29 |
WordPress | 278 | 30.50 MB | 30 Jul 2016 - 16:00 |
FavIconizer | 231 | 7.73 MB | 31 Jul 2016 - 15:14 |
MJ12bot | 188+19 | 19.34 MB | 31 Jul 2016 - 13:13 |
MagpieRSS | 145 | 1.21 MB | 31 Jul 2016 - 23:29 |
Sogou Spider | 95+43 | 37.08 MB | 31 Jul 2016 - 21:48 |
Feedfetcher-Google | 62 | 1.62 MB | 31 Jul 2016 - 03:31 |
Nutch | 25+33 | 10.27 MB | 26 Jul 2016 - 05:23 |
WGet tools | 57 | 43.84 MB | 24 Jul 2016 - 16:29 |
Unknown robot (identified by 'spider') | 45+10 | 8.73 MB | 31 Jul 2016 - 05:13 |
SeznamBot | 14+39 | 54.69 KB | 31 Jul 2016 - 19:38 |
CFNetwork | 51 | 10.25 MB | 30 Jul 2016 - 12:51 |
FaceBook bot | 48 | 3.43 MB | 29 Jul 2016 - 09:51 |
Alexa (IA Archiver) | 22+25 | 4.04 MB | 30 Jul 2016 - 16:55 |
Harvest | 42 | 110.03 KB | 31 Jul 2016 - 19:26 |
MSNBot-media | 39 | 2.72 MB | 31 Jul 2016 - 21:09 |
Exabot | 27+12 | 1.15 MB | 30 Jul 2016 - 18:34 |
LinkChecker | 25 | 3.39 MB | 30 Jul 2016 - 22:15 |
Jakarta commons-httpclient | 23 | 8.75 MB | 28 Jul 2016 - 01:13 |
Perl tool | 23 | 130.47 KB | 28 Jul 2016 - 23:22 |
Web Core / Roots | 20 | 1.48 MB | 29 Jul 2016 - 20:36 |
archive.org bot | 6+11 | 15.72 MB | 31 Jul 2016 - 11:13 |
Unknown robot (identified by 'checker') | 16 | 0 | 29 Jul 2016 - 22:28 |
Turn It In | 5+5 | 4.54 MB | 30 Jul 2016 - 18:44 |
Sift | 9 | 145.45 KB | 22 Jul 2016 - 05:01 |
Heritrix | 6+2 | 640.88 KB | 30 Jul 2016 - 12:17 |
HTTrack off-line browser | 6 | 8.10 MB | 21 Jul 2016 - 16:28 |
Phantom | 3 | 1.19 MB | 16 Jul 2016 - 07:02 |
Powermarks | 2 | 36.95 KB | 24 Jul 2016 - 02:12 |
MSNBot | 2 | 24.56 KB | 15 Jul 2016 - 15:31 |
Custo | 0+2 | 178 Bytes | 03 Jul 2016 - 22:24 |
TITAN | 2 | 1.06 MB | 22 Jul 2016 - 08:47 |
WebFilter | 1+1 | 16.42 KB | 30 Jul 2016 - 17:34 |
Netcraft | 2 | 8.56 KB | 14 Jul 2016 - 09:10 |
LinkWalker | 0+1 | 89 Bytes | 26 Jul 2016 - 06:43 |
NG 1.x (Exalead) | 1 | 1.79 MB | 19 Jul 2016 - 07:59 |
SpiderBot | 0+1 | 89 Bytes | 06 Jul 2016 - 08:54 |
MSIECrawler | 1 | 18.47 KB | 23 Jul 2016 - 20:53 |