39 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 19150+407 | 17.38 GB | 30 Sep 2006 - 23:15 |
Heritrix | 6097+20 | 13.34 GB | 30 Sep 2006 - 15:35 |
NutchCVS | 1622+4 | 14.05 MB | 26 Sep 2006 - 13:51 |
Unknown robot (identified by 'bot*') | 1587+39 | 630.43 MB | 30 Sep 2006 - 22:18 |
Yahoo Slurp | 988+526 | 1.41 GB | 30 Sep 2006 - 23:55 |
Ask | 735+93 | 6.57 MB | 30 Sep 2006 - 13:17 |
Googlebot | 352+24 | 253.62 MB | 30 Sep 2006 - 06:02 |
LinkChecker | 329+2 | 2.55 MB | 30 Sep 2006 - 15:29 |
MSNBot | 179+119 | 13.83 MB | 30 Sep 2006 - 12:41 |
Java (Often spam bot) | 290 | 12.20 MB | 29 Sep 2006 - 22:18 |
ConveraCrawler | 262+1 | 365.11 MB | 11 Sep 2006 - 05:40 |
Shim-Crawler | 71+4 | 492.38 KB | 29 Sep 2006 - 12:53 |
MSNBot-media | 43+11 | 348.42 KB | 28 Sep 2006 - 13:24 |
Findlinks | 34+14 | 430.68 KB | 30 Sep 2006 - 17:07 |
Unknown robot (identified by empty user agent string) | 28+15 | 50.99 MB | 28 Sep 2006 - 14:00 |
Perl tool | 19 | 407.50 KB | 30 Sep 2006 - 20:51 |
WGet tools | 17+1 | 3.70 MB | 21 Sep 2006 - 02:13 |
Unknown robot (identified by hit on 'robots.txt') | 0+17 | 1.46 KB | 30 Sep 2006 - 00:34 |
Harvest | 16 | 22.34 KB | 26 Sep 2006 - 16:36 |
larbin | 12+3 | 36.26 KB | 11 Sep 2006 - 11:03 |
BaiDuSpider | 5+2 | 1.30 MB | 28 Sep 2006 - 22:51 |
Voyager | 3+3 | 7.39 KB | 14 Sep 2006 - 01:59 |
Girafabot | 3+2 | 13.80 KB | 19 Sep 2006 - 05:31 |
Exabot | 3+2 | 17.76 KB | 25 Sep 2006 - 22:20 |
ichiro | 3+2 | 13.27 KB | 25 Sep 2006 - 14:27 |
GigaBot | 2+2 | 8.01 KB | 25 Sep 2006 - 04:14 |
Jakarta commons-httpclient | 3 | 17.96 MB | 26 Sep 2006 - 14:42 |
psbot | 2+1 | 13.92 KB | 06 Sep 2006 - 19:31 |
MSRBOT | 2+1 | 2.42 MB | 30 Sep 2006 - 05:25 |
Cfetch | 2 | 0 | 15 Sep 2006 - 12:28 |
Custo | 2 | 1.10 MB | 05 Sep 2006 - 08:53 |
nicebot | 2 | 7.71 KB | 10 Sep 2006 - 15:22 |
MSIECrawler | 0+2 | 88 Bytes | 20 Sep 2006 - 08:22 |
Sogou Spider | 1+1 | 5.23 KB | 29 Sep 2006 - 21:55 |
Walhello appie | 0+1 | 88 Bytes | 30 Sep 2006 - 09:45 |
CFNetwork | 1 | 756.16 KB | 21 Sep 2006 - 00:28 |
yacy | 0+1 | 88 Bytes | 30 Sep 2006 - 16:42 |
Python-urllib | 1 | 1.21 MB | 14 Sep 2006 - 18:37 |
Others | 0 | 0 | |