59 different robots | Hits | Bandwidth | Last visit |
Feedfetcher-Google | 886 | 4.87 MB | 31 Jan 2012 - 23:59 |
Googlebot | 49795+34 | 29.50 GB | 31 Jan 2012 - 23:59 |
Unknown robot (identified by 'crawl') | 1295434+21917 | 26.39 GB | 31 Jan 2012 - 23:49 |
BaiDuSpider | 8378+74 | 623.02 MB | 31 Jan 2012 - 23:48 |
Unknown robot (identified by hit on 'robots.txt') | 0+334 | 10.11 KB | 31 Jan 2012 - 23:42 |
Nutch | 894+258 | 183.23 MB | 31 Jan 2012 - 23:38 |
Python-urllib | 108014+8 | 26.40 GB | 31 Jan 2012 - 23:37 |
Sogou Spider | 253+7 | 76.22 MB | 31 Jan 2012 - 23:37 |
Unknown robot (identified by '*bot') | 43+63 | 846.40 KB | 31 Jan 2012 - 23:34 |
Unknown robot (identified by 'bot*') | 11575+883 | 3.60 GB | 31 Jan 2012 - 23:22 |
Unknown robot (identified by empty user agent string) | 944+33 | 973.24 MB | 31 Jan 2012 - 23:22 |
archive.org bot | 37+12 | 19.41 MB | 31 Jan 2012 - 23:15 |
Unknown robot (identified by 'spider') | 700+19 | 206.01 MB | 31 Jan 2012 - 23:09 |
Yandex bot | 24130+36 | 7.29 GB | 31 Jan 2012 - 22:38 |
Exabot | 22+8 | 255.70 KB | 31 Jan 2012 - 22:02 |
WordPress | 130 | 85.98 MB | 31 Jan 2012 - 20:23 |
FaceBook bot | 106 | 5.83 MB | 31 Jan 2012 - 19:58 |
Yahoo Slurp | 51+43 | 50.93 MB | 31 Jan 2012 - 16:13 |
Harvest | 58 | 335.96 KB | 31 Jan 2012 - 15:36 |
Jakarta commons-httpclient | 64 | 6.84 MB | 31 Jan 2012 - 15:35 |
Unknown robot (identified by 'discovery') | 366+16 | 1.24 GB | 31 Jan 2012 - 15:19 |
BSpider | 0+28 | 868 Bytes | 31 Jan 2012 - 14:28 |
Java (Often spam bot) | 382+1 | 137.17 MB | 31 Jan 2012 - 13:13 |
GigaBot | 8+8 | 57.23 KB | 31 Jan 2012 - 12:46 |
Speedy Spider | 21+15 | 15.22 MB | 31 Jan 2012 - 10:36 |
yacy | 328+9 | 60.46 MB | 31 Jan 2012 - 09:44 |
MSNBot-media | 55+27 | 2.39 MB | 31 Jan 2012 - 04:27 |
Perl tool | 16 | 12.62 MB | 31 Jan 2012 - 01:49 |
Mail.ru bot | 5+2 | 2.91 MB | 31 Jan 2012 - 00:08 |
MJ12bot | 108+22 | 7.81 MB | 30 Jan 2012 - 22:41 |
Alexa (IA Archiver) | 0+6 | 186 Bytes | 30 Jan 2012 - 20:35 |
legs | 0+2 | 62 Bytes | 30 Jan 2012 - 16:27 |
Turn It In | 0+1 | 31 Bytes | 30 Jan 2012 - 09:46 |
WGet tools | 37 | 26.55 MB | 30 Jan 2012 - 04:02 |
Findlinks | 6+7 | 224.05 KB | 29 Jan 2012 - 23:10 |
BBot | 2 | 2.43 MB | 29 Jan 2012 - 10:36 |
Unknown robot (identified by 'robot') | 3724+22 | 231.92 MB | 28 Jan 2012 - 10:48 |
Netcraft | 1 | 0 | 27 Jan 2012 - 12:16 |
OutfoxBot/YodaoBot | 70 | 498.61 KB | 27 Jan 2012 - 05:34 |
ichiro | 4+3 | 109.82 KB | 26 Jan 2012 - 02:40 |
MSNBot | 26+3 | 579.20 KB | 25 Jan 2012 - 15:59 |
psbot | 4+5 | 142.31 KB | 25 Jan 2012 - 12:21 |
LinkChecker | 4+2 | 26.63 KB | 25 Jan 2012 - 09:10 |
Powermarks | 18 | 3.07 MB | 25 Jan 2012 - 08:26 |
DoCoMo | 1+2 | 30.35 KB | 25 Jan 2012 - 07:46 |
W3C Link Checker | 3+3 | 93 Bytes | 25 Jan 2012 - 03:23 |
CFNetwork | 38 | 37.94 MB | 23 Jan 2012 - 23:54 |
MSIECrawler | 0+1 | 31 Bytes | 23 Jan 2012 - 02:05 |
Pioneer | 1 | 7.12 KB | 23 Jan 2012 - 01:34 |
HTTrack off-line browser | 7 | 10.78 MB | 21 Jan 2012 - 12:16 |
FavIconizer | 5 | 2.45 MB | 19 Jan 2012 - 09:36 |
W3C Validator | 1 | 432.86 KB | 18 Jan 2012 - 12:30 |
VORTEX | 1 | 37.45 KB | 16 Jan 2012 - 15:05 |
Raven Search | 2 | 1.39 MB | 15 Jan 2012 - 10:03 |
bender focused_crawler | 103+3 | 28.36 MB | 15 Jan 2012 - 04:37 |
SeznamBot | 2+3 | 93 Bytes | 15 Jan 2012 - 02:38 |
UCSD Crawl | 1 | 1.79 MB | 10 Jan 2012 - 14:23 |
Heritrix | 1+1 | 1.21 MB | 04 Jan 2012 - 18:06 |
SuperBot | 1 | 1.21 MB | 03 Jan 2012 - 20:56 |