55 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 338159+507 | 3.72 GB | 31 Dec 2010 - 23:59 |
Yahoo Slurp | 22174+83 | 21.01 GB | 31 Dec 2010 - 23:58 |
Googlebot | 13791+35 | 16.90 GB | 31 Dec 2010 - 23:56 |
Unknown robot (identified by 'bot*') | 6766+1354 | 2.21 GB | 31 Dec 2010 - 23:56 |
Yandex bot | 668+34 | 333.66 MB | 31 Dec 2010 - 23:30 |
Unknown robot (identified by empty user agent string) | 401+17 | 418.01 MB | 31 Dec 2010 - 22:07 |
BaiDuSpider | 437+59 | 154.96 MB | 31 Dec 2010 - 21:23 |
Exabot | 25+13 | 263.78 KB | 31 Dec 2010 - 21:17 |
Unknown robot (identified by 'spider') | 35+18 | 6.24 MB | 31 Dec 2010 - 18:58 |
Motor | 28 | 69.02 MB | 31 Dec 2010 - 18:11 |
Sogou Spider | 35+4 | 13.91 MB | 31 Dec 2010 - 17:46 |
Bloglines | 221 | 940.11 KB | 31 Dec 2010 - 17:01 |
Speedy Spider | 88+69 | 8.49 MB | 31 Dec 2010 - 15:37 |
Custo | 244+35 | 114.17 MB | 31 Dec 2010 - 14:09 |
FaceBook bot | 7 | 1.36 MB | 31 Dec 2010 - 13:01 |
Unknown robot (identified by 'discovery') | 2634+116 | 6.74 GB | 31 Dec 2010 - 07:01 |
Unknown robot (identified by 'robot') | 194+38 | 82.05 MB | 30 Dec 2010 - 23:54 |
GigaBot | 3+4 | 1.46 MB | 30 Dec 2010 - 23:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+101 | 2.97 KB | 30 Dec 2010 - 22:12 |
legs | 2+6 | 14.21 KB | 30 Dec 2010 - 18:54 |
MSIECrawler | 17+9 | 1.60 MB | 30 Dec 2010 - 15:20 |
Powermarks | 1 | 34.68 KB | 30 Dec 2010 - 14:21 |
MJ12bot | 227+48 | 3.20 MB | 29 Dec 2010 - 22:42 |
MSNBot-media | 78+31 | 3.52 MB | 29 Dec 2010 - 15:28 |
Netcraft | 2 | 14.03 KB | 29 Dec 2010 - 14:31 |
yacy | 2+3 | 202.03 KB | 29 Dec 2010 - 10:12 |
Voila | 0+5 | 155 Bytes | 29 Dec 2010 - 08:55 |
Java (Often spam bot) | 77+1 | 19.90 MB | 28 Dec 2010 - 20:48 |
Harvest | 40 | 128.16 KB | 28 Dec 2010 - 15:36 |
WordPress | 66 | 16.37 MB | 28 Dec 2010 - 15:25 |
Ask | 189+17 | 336.72 MB | 28 Dec 2010 - 12:06 |
Perl tool | 21 | 7.64 MB | 28 Dec 2010 - 08:13 |
larbin | 2+2 | 14.09 KB | 27 Dec 2010 - 21:20 |
lwp-trivial | 1 | 7.02 KB | 27 Dec 2010 - 15:49 |
Python-urllib | 49 | 62.41 MB | 27 Dec 2010 - 13:14 |
The web archive (IA Archiver) | 0+9 | 279 Bytes | 27 Dec 2010 - 11:04 |
WGet tools | 18 | 59.84 MB | 27 Dec 2010 - 10:00 |
Findlinks | 1+1 | 37.48 KB | 27 Dec 2010 - 02:22 |
CFNetwork | 1 | 44.53 KB | 26 Dec 2010 - 03:23 |
Nutch | 35+6 | 2.30 MB | 25 Dec 2010 - 13:28 |
Voyager | 4 | 319.13 KB | 24 Dec 2010 - 06:59 |
Heritrix | 3+3 | 4.80 MB | 23 Dec 2010 - 12:41 |
Spiderman | 1196+20 | 72.63 MB | 22 Dec 2010 - 11:59 |
OutfoxBot/YodaoBot | 4+2 | 31.47 KB | 22 Dec 2010 - 00:51 |
Jakarta commons-httpclient | 49 | 18.05 MB | 22 Dec 2010 - 00:16 |
DoCoMo | 10+7 | 361.25 KB | 20 Dec 2010 - 21:36 |
BBot | 2 | 906.87 KB | 15 Dec 2010 - 11:39 |
QihooBot | 1 | 7.02 KB | 14 Dec 2010 - 02:12 |
NG 1.x (Exalead) | 5 | 4.90 MB | 13 Dec 2010 - 15:36 |
Flexum Search Engine | 5+5 | 35.23 KB | 12 Dec 2010 - 04:24 |
Combine System | 2+1 | 1.61 MB | 12 Dec 2010 - 01:06 |
Unknown robot (identified by '*bot') | 1 | 1.21 MB | 09 Dec 2010 - 23:14 |
MSNBot | 1+1 | 7.05 KB | 04 Dec 2010 - 09:47 |
FavIconizer | 1 | 7.02 KB | 03 Dec 2010 - 18:31 |
HTTrack off-line browser | 1 | 349.72 KB | 02 Dec 2010 - 08:25 |