| 53 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 871398+826 | 6.20 GB | 30 Apr 2010 - 23:12 |
| MSNBot | 19191+955 | 25.96 GB | 30 Apr 2010 - 23:57 |
| Yahoo Slurp | 14901+77 | 13.46 GB | 30 Apr 2010 - 23:59 |
| Googlebot | 6439+34 | 7.70 GB | 30 Apr 2010 - 19:52 |
| Unknown robot (identified by 'bot*') | 2086+42 | 2.52 GB | 30 Apr 2010 - 00:07 |
| twiceler | 951+321 | 322.04 MB | 30 Apr 2010 - 23:27 |
| Unknown robot (identified by 'spider') | 543+22 | 18.97 MB | 30 Apr 2010 - 21:25 |
| Turn It In | 535+13 | 61.74 MB | 28 Apr 2010 - 06:21 |
| BaiDuSpider | 363+78 | 85.77 MB | 30 Apr 2010 - 23:50 |
| MSNBot-media | 205+124 | 10.68 MB | 30 Apr 2010 - 17:01 |
| Ask | 248+68 | 89.31 MB | 30 Apr 2010 - 11:02 |
| Exabot | 283+16 | 1.78 GB | 27 Apr 2010 - 19:30 |
| Custo | 189+75 | 105.49 MB | 30 Apr 2010 - 21:11 |
| Unknown robot (identified by hit on 'robots.txt') | 0+252 | 7.57 KB | 30 Apr 2010 - 18:35 |
| Unknown robot (identified by empty user agent string) | 179+56 | 70.24 MB | 30 Apr 2010 - 19:40 |
| Bloglines | 188 | 784.13 KB | 30 Apr 2010 - 20:53 |
| Jakarta commons-httpclient | 150+3 | 229.90 MB | 30 Apr 2010 - 15:58 |
| Java (Often spam bot) | 119+1 | 14.47 MB | 29 Apr 2010 - 11:07 |
| Speedy Spider | 42+39 | 6.71 MB | 30 Apr 2010 - 06:15 |
| Yandex bot | 39+24 | 3.94 MB | 30 Apr 2010 - 02:00 |
| legs | 10+50 | 3.30 MB | 26 Apr 2010 - 14:51 |
| MJ12bot | 56+3 | 808.50 KB | 14 Apr 2010 - 20:19 |
| Harvest | 56 | 1.52 MB | 27 Apr 2010 - 20:03 |
| Unknown robot (identified by 'robot') | 31+19 | 28.59 MB | 30 Apr 2010 - 05:25 |
| Feedfetcher-Google | 45 | 187.69 KB | 06 Apr 2010 - 15:02 |
| Nutch | 30+14 | 317.65 KB | 27 Apr 2010 - 09:04 |
| WordPress | 33 | 10.66 MB | 29 Apr 2010 - 20:18 |
| Voila | 19+10 | 196.77 KB | 30 Apr 2010 - 18:17 |
| GigaBot | 14+14 | 96.13 KB | 30 Apr 2010 - 15:00 |
| MSIECrawler | 0+26 | 434 Bytes | 30 Apr 2010 - 08:18 |
| yacy | 17+7 | 5.72 MB | 30 Apr 2010 - 07:14 |
| Perl tool | 22 | 752.34 KB | 28 Apr 2010 - 19:43 |
| Python-urllib | 17+5 | 7.18 MB | 25 Apr 2010 - 07:05 |
| WGet tools | 20 | 20.33 MB | 30 Apr 2010 - 05:35 |
| Sogou Spider | 2+14 | 10.58 KB | 30 Apr 2010 - 15:43 |
| The web archive (IA Archiver) | 0+13 | 403 Bytes | 28 Apr 2010 - 03:20 |
| CFNetwork | 7 | 5.73 MB | 23 Apr 2010 - 11:37 |
| larbin | 2+3 | 74.99 KB | 27 Apr 2010 - 19:09 |
| EasyDL | 4 | 99.57 KB | 19 Apr 2010 - 03:19 |
| Heritrix | 2+2 | 353.77 KB | 28 Apr 2010 - 08:43 |
| FaceBook bot | 3 | 5.25 MB | 28 Apr 2010 - 19:34 |
| Voyager | 3 | 2.16 MB | 23 Apr 2010 - 11:22 |
| BBot | 3 | 2.60 MB | 11 Apr 2010 - 07:36 |
| psbot | 1+1 | 37.48 KB | 22 Apr 2010 - 03:43 |
| Unknown robot (identified by 'scanner') | 1+1 | 3.77 MB | 02 Apr 2010 - 07:43 |
| SPIP | 1+1 | 1.21 MB | 22 Apr 2010 - 20:46 |
| HTTrack off-line browser | 2 | 2.43 MB | 02 Apr 2010 - 16:21 |
| Netcraft | 2 | 6.84 KB | 08 Apr 2010 - 20:22 |
| gammaSpider, FocusedCrawler | 1 | 36.58 KB | 29 Apr 2010 - 12:05 |
| Sift | 1 | 1.61 MB | 19 Apr 2010 - 08:26 |
| arks | 1 | 153.83 KB | 23 Apr 2010 - 04:40 |
| Fish search | 1 | 14.24 KB | 27 Apr 2010 - 01:30 |
| ichiro | 0+1 | 31 Bytes | 05 Apr 2010 - 16:00 |