44 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 10989+573 | 4.91 GB | 30 Apr 2006 - 01:44 |
Java (Often spam bot) | 4005+5 | 26.91 MB | 29 Apr 2006 - 21:32 |
Heritrix | 2389+3 | 5.47 GB | 29 Apr 2006 - 00:21 |
Googlebot | 2280+26 | 1.40 GB | 29 Apr 2006 - 21:07 |
Unknown robot (identified by 'bot*') | 1873+15 | 4.03 GB | 28 Apr 2006 - 20:54 |
Ask | 1091+42 | 9.27 MB | 30 Apr 2006 - 02:42 |
MSNBot | 297+220 | 237.11 MB | 30 Apr 2006 - 02:10 |
Yahoo Slurp | 155+134 | 77.20 MB | 29 Apr 2006 - 23:49 |
LinkChecker | 246+1 | 1.94 MB | 26 Apr 2006 - 13:22 |
Turn It In | 179+1 | 599.22 MB | 21 Apr 2006 - 05:25 |
BecomeBot | 121+55 | 1.13 MB | 29 Apr 2006 - 04:45 |
Unknown robot (identified by empty user agent string) | 89+13 | 9.82 MB | 29 Apr 2006 - 09:56 |
noxtrumbot | 68+1 | 487.90 KB | 29 Apr 2006 - 00:50 |
Findlinks | 46+10 | 296.33 KB | 28 Apr 2006 - 19:28 |
Unknown robot (identified by hit on 'robots.txt') | 0+53 | 4.55 KB | 30 Apr 2006 - 02:10 |
ZyBorg | 47+5 | 394.94 KB | 29 Apr 2006 - 16:19 |
Voyager | 16+7 | 84.51 KB | 26 Apr 2006 - 22:49 |
Harvest | 20 | 27.92 KB | 25 Apr 2006 - 16:36 |
GigaBot | 4+5 | 3.78 MB | 27 Apr 2006 - 18:21 |
MSIECrawler | 5+2 | 24.09 KB | 28 Apr 2006 - 17:56 |
HTMLParser | 6 | 30.87 KB | 14 Apr 2006 - 02:57 |
Python-urllib | 6 | 869.49 KB | 05 Apr 2006 - 14:45 |
psbot | 3+2 | 19.46 KB | 22 Apr 2006 - 09:01 |
Girafabot | 3+2 | 13.80 KB | 27 Apr 2006 - 19:34 |
ConveraCrawler | 2+2 | 621 Bytes | 04 Apr 2006 - 19:46 |
larbin | 2+2 | 10.46 KB | 10 Apr 2006 - 13:50 |
boitho.com-dc | 2+1 | 6.70 KB | 20 Apr 2006 - 08:15 |
CFNetwork | 3 | 1.59 MB | 11 Apr 2006 - 07:21 |
HTTrack off-line browser | 2+1 | 533 Bytes | 02 Apr 2006 - 23:10 |
NutchCVS | 1+1 | 5.23 KB | 08 Apr 2006 - 10:32 |
Geniebot | 1+1 | 5.23 KB | 20 Apr 2006 - 00:59 |
WGet tools | 1+1 | 1.21 MB | 28 Apr 2006 - 04:22 |
BaiDuSpider | 1+1 | 5.23 KB | 11 Apr 2006 - 15:17 |
ConveraMultiMediaCrawler | 1+1 | 5.25 KB | 26 Apr 2006 - 19:29 |
WebFilter | 0+2 | 176 Bytes | 13 Apr 2006 - 16:21 |
Sogou Spider | 2 | 890 Bytes | 18 Apr 2006 - 04:12 |
Jakarta commons-httpclient | 1 | 465.78 KB | 29 Apr 2006 - 01:27 |
Vagabondo-WAP | 1 | 5.14 KB | 03 Apr 2006 - 20:34 |
Vagabondo | 0+1 | 88 Bytes | 03 Apr 2006 - 20:34 |
Unknown robot (identified by '*bot') | 0+1 | 88 Bytes | 22 Apr 2006 - 02:58 |
Custo | 1 | 2.30 MB | 28 Apr 2006 - 19:33 |
yacy | 0+1 | 88 Bytes | 29 Apr 2006 - 12:59 |
Unknown robot (identified by 'robot') | 0+1 | 88 Bytes | 28 Apr 2006 - 16:16 |
Fast-Webcrawler | 0+1 | 88 Bytes | 06 Apr 2006 - 12:21 |