47 different robots | Hits | Bandwidth | Last visit |
MSNBot | 21842+2058 | 14.61 GB | 30 Sep 2009 - 23:58 |
Yahoo Slurp | 11724+133 | 14.40 GB | 30 Sep 2009 - 23:55 |
Googlebot | 11387+32 | 17.04 GB | 30 Sep 2009 - 23:45 |
Bloglines | 200 | 814.84 KB | 30 Sep 2009 - 23:32 |
Ask | 1204+111 | 615.39 MB | 30 Sep 2009 - 22:51 |
Feedfetcher-Google | 231 | 941.14 KB | 30 Sep 2009 - 22:42 |
Jakarta commons-httpclient | 148+3 | 81.61 MB | 30 Sep 2009 - 22:17 |
Unknown robot (identified by 'bot*') | 5959+30 | 5.49 GB | 30 Sep 2009 - 22:17 |
Unknown robot (identified by hit on 'robots.txt') | 0+306 | 9.26 KB | 30 Sep 2009 - 22:02 |
Unknown robot (identified by 'robot') | 33+22 | 19.40 MB | 30 Sep 2009 - 22:00 |
BaiDuSpider | 412+47 | 13.32 MB | 30 Sep 2009 - 21:39 |
Unknown robot (identified by empty user agent string) | 90+30 | 36.74 MB | 30 Sep 2009 - 20:23 |
yacy | 9+11 | 4.10 MB | 30 Sep 2009 - 19:28 |
GigaBot | 11+11 | 74.46 KB | 30 Sep 2009 - 19:16 |
Voila | 18+12 | 180.86 KB | 30 Sep 2009 - 16:20 |
Yandex bot | 15+14 | 1.64 MB | 30 Sep 2009 - 15:04 |
Unknown robot (identified by 'crawl') | 709547+566 | 6.04 GB | 30 Sep 2009 - 14:55 |
Custo | 188+53 | 90.49 MB | 30 Sep 2009 - 13:52 |
Exabot | 43+13 | 969.14 KB | 30 Sep 2009 - 09:32 |
The web archive (IA Archiver) | 0+4 | 124 Bytes | 30 Sep 2009 - 09:23 |
legs | 0+20 | 620 Bytes | 30 Sep 2009 - 08:51 |
twiceler | 314+26 | 4.45 MB | 30 Sep 2009 - 06:56 |
Nutch | 10+10 | 6.85 MB | 30 Sep 2009 - 04:25 |
Speedy Spider | 20+14 | 62.89 KB | 29 Sep 2009 - 21:32 |
FaceBook bot | 11 | 4.27 MB | 29 Sep 2009 - 20:58 |
Java (Often spam bot) | 38+2 | 3.50 MB | 29 Sep 2009 - 20:46 |
BBot | 4 | 2.96 MB | 29 Sep 2009 - 20:46 |
Heritrix | 1094+17 | 1.87 GB | 29 Sep 2009 - 19:57 |
MSIECrawler | 4+15 | 3.65 MB | 29 Sep 2009 - 16:38 |
Harvest | 55 | 1.32 MB | 29 Sep 2009 - 16:36 |
Python-urllib | 177+2 | 36.51 MB | 29 Sep 2009 - 09:11 |
WordPress | 50 | 19.69 MB | 29 Sep 2009 - 03:59 |
Unknown robot (identified by 'discovery') | 9+10 | 7.31 MB | 29 Sep 2009 - 03:08 |
MJ12bot | 117+7 | 1.29 MB | 27 Sep 2009 - 22:27 |
CFNetwork | 4 | 2.75 MB | 27 Sep 2009 - 14:54 |
Perl tool | 1 | 1.21 MB | 26 Sep 2009 - 03:22 |
Unknown robot (identified by 'spider') | 1+1 | 1.21 MB | 25 Sep 2009 - 22:40 |
TITAN | 1 | 1.21 MB | 25 Sep 2009 - 09:37 |
WGet tools | 7 | 1.88 MB | 25 Sep 2009 - 08:36 |
larbin | 4+5 | 2.44 MB | 19 Sep 2009 - 05:49 |
Turn It In | 0+2 | 62 Bytes | 18 Sep 2009 - 02:54 |
Sogou Spider | 1 | 93.89 KB | 14 Sep 2009 - 14:50 |
Voyager | 0+5 | 155 Bytes | 11 Sep 2009 - 06:06 |
Netcraft | 1 | 6.74 KB | 07 Sep 2009 - 15:13 |
NG 2.x (Exalead) | 1+1 | 1.21 MB | 05 Sep 2009 - 06:03 |
psbot | 2+2 | 18.27 KB | 05 Sep 2009 - 01:07 |
HTTrack off-line browser | 2 | 353.71 KB | 03 Sep 2009 - 04:26 |