53 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 13821+835 | 2.58 GB | 30 Apr 2011 - 23:59 |
Googlebot | 38283+33 | 15.21 GB | 30 Apr 2011 - 23:59 |
Yahoo Slurp | 51254+88 | 15.63 GB | 30 Apr 2011 - 23:57 |
Speedy Spider | 133+84 | 32.53 MB | 30 Apr 2011 - 23:47 |
Unknown robot (identified by 'crawl') | 873945+489 | 9.74 GB | 30 Apr 2011 - 23:38 |
BaiDuSpider | 453+67 | 124.59 MB | 30 Apr 2011 - 23:36 |
bender focused_crawler | 245+38 | 443.03 MB | 30 Apr 2011 - 23:31 |
Alexa (IA Archiver) | 1+1 | 13.16 KB | 30 Apr 2011 - 23:22 |
Feedfetcher-Google | 216 | 1.37 MB | 30 Apr 2011 - 23:03 |
MSNBot-media | 167+50 | 7.27 MB | 30 Apr 2011 - 22:32 |
CFNetwork | 16 | 26.54 MB | 30 Apr 2011 - 22:14 |
Unknown robot (identified by hit on 'robots.txt') | 0+121 | 3.60 KB | 30 Apr 2011 - 22:03 |
Exabot | 15+7 | 172.06 KB | 30 Apr 2011 - 21:15 |
Sogou Spider | 128+8 | 92.68 MB | 30 Apr 2011 - 21:09 |
OutfoxBot/YodaoBot | 87 | 619.71 KB | 30 Apr 2011 - 20:33 |
Custo | 348+55 | 206.51 MB | 30 Apr 2011 - 17:58 |
Unknown robot (identified by empty user agent string) | 970+35 | 658.33 MB | 30 Apr 2011 - 16:15 |
HTTrack off-line browser | 4 | 5.57 MB | 30 Apr 2011 - 14:29 |
Unknown robot (identified by 'robot') | 4306+27 | 50.89 MB | 30 Apr 2011 - 13:52 |
Yandex bot | 6780+38 | 2.36 GB | 30 Apr 2011 - 13:40 |
Unknown robot (identified by 'discovery') | 1387+1080 | 1.24 GB | 30 Apr 2011 - 02:12 |
Steeler | 2+2 | 1.22 MB | 30 Apr 2011 - 00:07 |
MJ12bot | 5+7 | 44.15 KB | 29 Apr 2011 - 20:49 |
Jakarta commons-httpclient | 64 | 24.03 MB | 29 Apr 2011 - 15:04 |
FaceBook bot | 36+6 | 4.19 MB | 29 Apr 2011 - 13:49 |
Findlinks | 4+5 | 149.96 KB | 29 Apr 2011 - 13:10 |
yacy | 4+4 | 2.64 MB | 28 Apr 2011 - 20:38 |
Nutch | 88+9 | 11.22 MB | 28 Apr 2011 - 16:19 |
Netcraft | 1 | 7.12 KB | 28 Apr 2011 - 13:26 |
WordPress | 57 | 11.04 MB | 28 Apr 2011 - 06:07 |
MSIECrawler | 0+18 | 372 Bytes | 28 Apr 2011 - 01:27 |
Unknown robot (identified by 'spider') | 526+20 | 55.07 MB | 27 Apr 2011 - 17:35 |
Unknown robot (identified by '*bot') | 22+40 | 600.17 KB | 27 Apr 2011 - 14:54 |
WGet tools | 27+3 | 27.94 MB | 27 Apr 2011 - 04:32 |
archive.org bot | 1+1 | 45.04 KB | 27 Apr 2011 - 03:47 |
ichiro | 97+9 | 7.00 MB | 27 Apr 2011 - 02:01 |
larbin | 1+1 | 7.15 KB | 26 Apr 2011 - 18:59 |
Harvest | 82 | 6.74 MB | 26 Apr 2011 - 16:36 |
Fish search | 1 | 7.12 KB | 24 Apr 2011 - 21:58 |
Motor | 33 | 19.72 MB | 24 Apr 2011 - 13:31 |
Java (Often spam bot) | 142 | 20.49 MB | 24 Apr 2011 - 11:51 |
legs | 2+12 | 2.43 MB | 24 Apr 2011 - 03:14 |
Perl tool | 15 | 3.05 MB | 22 Apr 2011 - 10:39 |
Heritrix | 1989+5 | 99.06 MB | 21 Apr 2011 - 22:41 |
Python-urllib | 37+1 | 26.49 MB | 21 Apr 2011 - 16:28 |
Voyager | 2 | 1.22 MB | 21 Apr 2011 - 02:38 |
The web archive (IA Archiver) | 0+3 | 93 Bytes | 19 Apr 2011 - 22:21 |
FavIconizer | 2 | 14.25 KB | 19 Apr 2011 - 13:14 |
MSNBot | 114+19 | 764.27 KB | 19 Apr 2011 - 12:56 |
HTMLParser | 12 | 2.42 MB | 18 Apr 2011 - 08:20 |
Powermarks | 1 | 8.53 KB | 14 Apr 2011 - 23:12 |
Unknown robot (identified by 'scanner') | 1+1 | 1.21 MB | 13 Apr 2011 - 05:53 |
T-H-U-N-D-E-R-S-T-O-N-E | 2+1 | 10.61 KB | 13 Apr 2011 - 03:00 |