40 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 1840+29 | 2.60 GB | 30 Jun 2006 - 23:59 |
MSNBot | 137+117 | 10.93 MB | 30 Jun 2006 - 23:54 |
Yahoo Slurp | 631+412 | 890.70 MB | 30 Jun 2006 - 23:19 |
Unknown robot (identified by 'crawl') | 16825+432 | 17.23 GB | 30 Jun 2006 - 23:11 |
Unknown robot (identified by empty user agent string) | 31+18 | 9.08 MB | 30 Jun 2006 - 22:24 |
Ask | 389+41 | 7.36 MB | 30 Jun 2006 - 21:02 |
Googlebot | 6649+28 | 7.06 GB | 30 Jun 2006 - 20:58 |
Findlinks | 21+7 | 128.22 KB | 30 Jun 2006 - 20:09 |
larbin | 29+31 | 117.36 KB | 30 Jun 2006 - 15:27 |
Unknown robot (identified by hit on 'robots.txt') | 0+31 | 2.66 KB | 30 Jun 2006 - 10:05 |
Unknown robot (identified by 'robot') | 0+24 | 1.55 KB | 30 Jun 2006 - 08:43 |
Python-urllib | 28 | 3.69 MB | 30 Jun 2006 - 01:18 |
Turn It In | 367+2 | 1000.13 MB | 30 Jun 2006 - 00:24 |
MJ12bot | 3+2 | 15.46 KB | 29 Jun 2006 - 13:19 |
Perl tool | 3 | 381.03 KB | 29 Jun 2006 - 13:06 |
Java (Often spam bot) | 933 | 6.46 MB | 29 Jun 2006 - 11:10 |
ZyBorg | 24+4 | 149.75 KB | 29 Jun 2006 - 11:02 |
BecomeBot | 6+7 | 34.64 KB | 29 Jun 2006 - 01:59 |
NutchCVS | 2+2 | 10.46 KB | 28 Jun 2006 - 22:52 |
GigaBot | 1+3 | 5.40 KB | 27 Jun 2006 - 23:51 |
Harvest | 17 | 27.56 KB | 27 Jun 2006 - 16:37 |
ConveraCrawler | 2+2 | 2.68 KB | 26 Jun 2006 - 23:36 |
WGet tools | 2+2 | 1.29 MB | 25 Jun 2006 - 04:57 |
WebFilter | 0+2 | 176 Bytes | 24 Jun 2006 - 05:59 |
MSIECrawler | 0+2 | 88 Bytes | 24 Jun 2006 - 05:18 |
Unknown robot (identified by 'spider') | 0+1 | 88 Bytes | 23 Jun 2006 - 17:10 |
Girafabot | 3+2 | 13.80 KB | 23 Jun 2006 - 09:13 |
Voyager | 12+6 | 60.28 KB | 22 Jun 2006 - 19:54 |
nicebot | 4+1 | 16.58 KB | 22 Jun 2006 - 10:42 |
Alexa (IA Archiver) | 1+1 | 214.05 KB | 22 Jun 2006 - 03:07 |
CFNetwork | 11 | 97.39 KB | 21 Jun 2006 - 12:33 |
WordPress | 18 | 10.93 MB | 21 Jun 2006 - 10:45 |
IRLbot | 25+4 | 80.24 KB | 21 Jun 2006 - 06:28 |
aipbot | 6+1 | 179.90 KB | 17 Jun 2006 - 05:45 |
Shim-Crawler | 1+1 | 5.23 KB | 16 Jun 2006 - 15:44 |
noxtrumbot | 1+1 | 5.23 KB | 14 Jun 2006 - 23:11 |
LinkChecker | 245+1 | 1.93 MB | 14 Jun 2006 - 03:37 |
MSNBot-media | 1+1 | 5.23 KB | 10 Jun 2006 - 21:09 |
Geniebot | 1+1 | 5.23 KB | 07 Jun 2006 - 14:38 |
Digger | 2+2 | 10.57 KB | 06 Jun 2006 - 01:52 |