53 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 871398+826 | 6.20 GB | 30 Apr 2010 - 23:12 |
MSNBot | 19191+955 | 25.96 GB | 30 Apr 2010 - 23:57 |
Yahoo Slurp | 14901+77 | 13.46 GB | 30 Apr 2010 - 23:59 |
Googlebot | 6439+34 | 7.70 GB | 30 Apr 2010 - 19:52 |
Unknown robot (identified by 'bot*') | 2086+42 | 2.52 GB | 30 Apr 2010 - 00:07 |
twiceler | 951+321 | 322.04 MB | 30 Apr 2010 - 23:27 |
Unknown robot (identified by 'spider') | 543+22 | 18.97 MB | 30 Apr 2010 - 21:25 |
Turn It In | 535+13 | 61.74 MB | 28 Apr 2010 - 06:21 |
BaiDuSpider | 363+78 | 85.77 MB | 30 Apr 2010 - 23:50 |
MSNBot-media | 205+124 | 10.68 MB | 30 Apr 2010 - 17:01 |
Ask | 248+68 | 89.31 MB | 30 Apr 2010 - 11:02 |
Exabot | 283+16 | 1.78 GB | 27 Apr 2010 - 19:30 |
Custo | 189+75 | 105.49 MB | 30 Apr 2010 - 21:11 |
Unknown robot (identified by hit on 'robots.txt') | 0+252 | 7.57 KB | 30 Apr 2010 - 18:35 |
Unknown robot (identified by empty user agent string) | 179+56 | 70.24 MB | 30 Apr 2010 - 19:40 |
Bloglines | 188 | 784.13 KB | 30 Apr 2010 - 20:53 |
Jakarta commons-httpclient | 150+3 | 229.90 MB | 30 Apr 2010 - 15:58 |
Java (Often spam bot) | 119+1 | 14.47 MB | 29 Apr 2010 - 11:07 |
Speedy Spider | 42+39 | 6.71 MB | 30 Apr 2010 - 06:15 |
Yandex bot | 39+24 | 3.94 MB | 30 Apr 2010 - 02:00 |
legs | 10+50 | 3.30 MB | 26 Apr 2010 - 14:51 |
MJ12bot | 56+3 | 808.50 KB | 14 Apr 2010 - 20:19 |
Harvest | 56 | 1.52 MB | 27 Apr 2010 - 20:03 |
Unknown robot (identified by 'robot') | 31+19 | 28.59 MB | 30 Apr 2010 - 05:25 |
Feedfetcher-Google | 45 | 187.69 KB | 06 Apr 2010 - 15:02 |
Nutch | 30+14 | 317.65 KB | 27 Apr 2010 - 09:04 |
WordPress | 33 | 10.66 MB | 29 Apr 2010 - 20:18 |
Voila | 19+10 | 196.77 KB | 30 Apr 2010 - 18:17 |
GigaBot | 14+14 | 96.13 KB | 30 Apr 2010 - 15:00 |
MSIECrawler | 0+26 | 434 Bytes | 30 Apr 2010 - 08:18 |
yacy | 17+7 | 5.72 MB | 30 Apr 2010 - 07:14 |
Perl tool | 22 | 752.34 KB | 28 Apr 2010 - 19:43 |
Python-urllib | 17+5 | 7.18 MB | 25 Apr 2010 - 07:05 |
WGet tools | 20 | 20.33 MB | 30 Apr 2010 - 05:35 |
Sogou Spider | 2+14 | 10.58 KB | 30 Apr 2010 - 15:43 |
The web archive (IA Archiver) | 0+13 | 403 Bytes | 28 Apr 2010 - 03:20 |
CFNetwork | 7 | 5.73 MB | 23 Apr 2010 - 11:37 |
larbin | 2+3 | 74.99 KB | 27 Apr 2010 - 19:09 |
EasyDL | 4 | 99.57 KB | 19 Apr 2010 - 03:19 |
Heritrix | 2+2 | 353.77 KB | 28 Apr 2010 - 08:43 |
FaceBook bot | 3 | 5.25 MB | 28 Apr 2010 - 19:34 |
Voyager | 3 | 2.16 MB | 23 Apr 2010 - 11:22 |
BBot | 3 | 2.60 MB | 11 Apr 2010 - 07:36 |
psbot | 1+1 | 37.48 KB | 22 Apr 2010 - 03:43 |
Unknown robot (identified by 'scanner') | 1+1 | 3.77 MB | 02 Apr 2010 - 07:43 |
SPIP | 1+1 | 1.21 MB | 22 Apr 2010 - 20:46 |
HTTrack off-line browser | 2 | 2.43 MB | 02 Apr 2010 - 16:21 |
Netcraft | 2 | 6.84 KB | 08 Apr 2010 - 20:22 |
gammaSpider, FocusedCrawler | 1 | 36.58 KB | 29 Apr 2010 - 12:05 |
Sift | 1 | 1.61 MB | 19 Apr 2010 - 08:26 |
arks | 1 | 153.83 KB | 23 Apr 2010 - 04:40 |
Fish search | 1 | 14.24 KB | 27 Apr 2010 - 01:30 |
ichiro | 0+1 | 31 Bytes | 05 Apr 2010 - 16:00 |