48 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 400177+864 | 7.49 GB | 30 Jun 2010 - 23:49 |
Yahoo Slurp | 17115+76 | 16.72 GB | 30 Jun 2010 - 23:58 |
MSNBot | 10008+975 | 16.91 GB | 30 Jun 2010 - 23:58 |
Googlebot | 9340+32 | 15.43 GB | 30 Jun 2010 - 23:49 |
twiceler | 2904+582 | 3.15 GB | 30 Jun 2010 - 23:51 |
Unknown robot (identified by 'bot*') | 1899+129 | 1.80 GB | 30 Jun 2010 - 21:16 |
Heritrix | 888+13 | 119.84 MB | 30 Jun 2010 - 23:53 |
MSNBot-media | 440+265 | 21.70 MB | 30 Jun 2010 - 23:25 |
archive.org bot | 601+6 | 14.13 MB | 30 Jun 2010 - 23:55 |
Unknown robot (identified by 'discovery') | 482+96 | 19.61 MB | 29 Jun 2010 - 19:02 |
Yandex bot | 381+27 | 305.57 MB | 30 Jun 2010 - 20:52 |
Ask | 269+112 | 110.56 MB | 30 Jun 2010 - 22:56 |
BaiDuSpider | 282+77 | 28.59 MB | 30 Jun 2010 - 23:14 |
Python-urllib | 258+1 | 316.64 MB | 30 Jun 2010 - 18:39 |
Custo | 169+49 | 162.97 MB | 30 Jun 2010 - 20:45 |
Bloglines | 204 | 855.76 KB | 30 Jun 2010 - 23:42 |
Unknown robot (identified by empty user agent string) | 130+55 | 43.46 MB | 30 Jun 2010 - 23:36 |
Unknown robot (identified by 'robot') | 149+24 | 21.18 MB | 29 Jun 2010 - 05:00 |
Unknown robot (identified by 'spider') | 122+4 | 1.72 MB | 27 Jun 2010 - 07:15 |
Exabot | 104+11 | 6.08 MB | 27 Jun 2010 - 19:57 |
Unknown robot (identified by hit on 'robots.txt') | 0+97 | 2.94 KB | 29 Jun 2010 - 17:56 |
Java (Often spam bot) | 67+2 | 3.75 MB | 28 Jun 2010 - 10:05 |
Harvest | 53 | 991.55 KB | 29 Jun 2010 - 16:36 |
Jakarta commons-httpclient | 46+1 | 29.61 MB | 27 Jun 2010 - 23:21 |
Speedy Spider | 18+17 | 4.24 MB | 25 Jun 2010 - 02:17 |
WordPress | 31 | 2.41 MB | 29 Jun 2010 - 16:05 |
Nutch | 17+12 | 10.31 MB | 10 Jun 2010 - 08:25 |
yacy | 14+10 | 7.58 MB | 27 Jun 2010 - 01:01 |
Perl tool | 20 | 3.99 MB | 30 Jun 2010 - 19:42 |
Sogou Spider | 1+19 | 5.35 KB | 29 Jun 2010 - 02:11 |
MSIECrawler | 1+15 | 7.33 KB | 30 Jun 2010 - 23:22 |
CFNetwork | 9 | 8.12 MB | 25 Jun 2010 - 19:20 |
legs | 2+7 | 75.11 KB | 22 Jun 2010 - 09:00 |
MJ12bot | 4+3 | 334.27 KB | 26 Jun 2010 - 19:38 |
Unknown robot (identified by 'scanner') | 4+1 | 7.41 MB | 17 Jun 2010 - 19:09 |
Voila | 0+5 | 155 Bytes | 30 Jun 2010 - 02:30 |
BBot | 4+1 | 3.31 MB | 27 Jun 2010 - 14:16 |
The web archive (IA Archiver) | 0+3 | 93 Bytes | 25 Jun 2010 - 10:46 |
WGet tools | 2 | 1.41 MB | 27 Jun 2010 - 13:06 |
Motor | 2 | 476.95 KB | 09 Jun 2010 - 02:24 |
EasyDL | 1 | 25.34 KB | 21 Jun 2010 - 14:26 |
FaceBook bot | 1 | 1.21 MB | 13 Jun 2010 - 03:36 |
HTMLParser | 1 | 1.21 MB | 04 Jun 2010 - 11:44 |
webcompass | 1 | 6.93 KB | 04 Jun 2010 - 20:05 |
Voyager | 1 | 1.21 MB | 10 Jun 2010 - 00:07 |
lwp-trivial | 1 | 37.45 KB | 16 Jun 2010 - 10:17 |
QihooBot | 1 | 6.84 KB | 01 Jun 2010 - 21:52 |
Netcraft | 1 | 6.93 KB | 08 Jun 2010 - 19:42 |