41 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 9740+682 | 2.51 GB | 30 Nov 2007 - 23:43 |
Googlebot | 4469+26 | 11.48 GB | 30 Nov 2007 - 23:40 |
Yahoo Slurp | 3243+98 | 3.56 GB | 30 Nov 2007 - 23:52 |
MSNBot | 2404+738 | 1.38 GB | 30 Nov 2007 - 23:35 |
Heritrix | 2655+16 | 4.31 GB | 30 Nov 2007 - 09:29 |
Nutch | 760+72 | 21.17 MB | 30 Nov 2007 - 18:05 |
Bloglines | 415 | 2.06 MB | 30 Nov 2007 - 21:52 |
Ask | 238+22 | 2.12 MB | 30 Nov 2007 - 23:17 |
twiceler | 0+165 | 14.18 KB | 27 Nov 2007 - 17:48 |
Unknown robot (identified by 'bot*') | 115+48 | 43.50 MB | 30 Nov 2007 - 12:43 |
Unknown robot (identified by hit on 'robots.txt') | 0+132 | 6.02 KB | 30 Nov 2007 - 18:54 |
Java (Often spam bot) | 106 | 2.06 MB | 30 Nov 2007 - 15:40 |
MSNBot-media | 66+23 | 670.82 KB | 29 Nov 2007 - 16:34 |
Unknown robot (identified by 'robot') | 45+31 | 671.02 KB | 29 Nov 2007 - 07:29 |
GigaBot | 57+18 | 791.51 KB | 23 Nov 2007 - 09:52 |
MSIECrawler | 5+62 | 4.19 MB | 30 Nov 2007 - 03:13 |
Unknown robot (identified by empty user agent string) | 50+6 | 6.60 MB | 30 Nov 2007 - 08:12 |
BaiDuSpider | 49+4 | 1.39 MB | 30 Nov 2007 - 20:06 |
MSRBOT | 31+18 | 4.42 MB | 24 Nov 2007 - 07:23 |
MJ12bot | 33+5 | 41.27 MB | 17 Nov 2007 - 06:15 |
NG 2.x (Exalead) | 17+5 | 88.87 KB | 26 Nov 2007 - 23:52 |
Harvest | 19 | 861.04 KB | 27 Nov 2007 - 15:36 |
ichiro | 13+1 | 133.82 KB | 28 Nov 2007 - 17:03 |
Speedy Spider | 4+4 | 2.44 MB | 28 Nov 2007 - 02:50 |
Voila | 3+3 | 169.79 KB | 26 Nov 2007 - 15:14 |
Exabot | 3+3 | 27.81 KB | 16 Nov 2007 - 03:09 |
Holmes | 3+1 | 15.97 KB | 26 Nov 2007 - 09:30 |
BecomeBot | 2+2 | 10.46 KB | 18 Nov 2007 - 14:25 |
archive.org bot | 2+2 | 2.12 MB | 29 Nov 2007 - 05:59 |
QihooBot | 4 | 1.23 MB | 29 Nov 2007 - 14:25 |
Sogou Spider | 2+2 | 194.46 KB | 15 Nov 2007 - 17:58 |
Cfetch | 3 | 0 | 24 Nov 2007 - 12:44 |
OutfoxBot/YodaoBot | 1+2 | 176 Bytes | 28 Nov 2007 - 23:48 |
Steeler | 2+1 | 5.67 KB | 05 Nov 2007 - 20:04 |
The web archive (IA Archiver) | 0+2 | 176 Bytes | 21 Nov 2007 - 05:53 |
CFNetwork | 2 | 22.14 MB | 22 Nov 2007 - 14:59 |
boitho.com-dc | 0+1 | 88 Bytes | 30 Nov 2007 - 11:01 |
WGet tools | 1 | 1.69 KB | 28 Nov 2007 - 10:53 |
Unknown robot (identified by 'hunter') | 0+1 | 88 Bytes | 21 Nov 2007 - 19:30 |
yacy | 0+1 | 88 Bytes | 11 Nov 2007 - 19:34 |
Internet Shinchakubin | 1 | 115.21 KB | 26 Nov 2007 - 12:19 |