| 47 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 709547+566 | 6.04 GB | 30 Sep 2009 - 14:55 |
| MSNBot | 21842+2058 | 14.61 GB | 30 Sep 2009 - 23:58 |
| Yahoo Slurp | 11724+133 | 14.40 GB | 30 Sep 2009 - 23:55 |
| Googlebot | 11387+32 | 17.04 GB | 30 Sep 2009 - 23:45 |
| Unknown robot (identified by 'bot*') | 5959+30 | 5.49 GB | 30 Sep 2009 - 22:17 |
| Ask | 1204+111 | 615.39 MB | 30 Sep 2009 - 22:51 |
| Heritrix | 1094+17 | 1.87 GB | 29 Sep 2009 - 19:57 |
| BaiDuSpider | 412+47 | 13.32 MB | 30 Sep 2009 - 21:39 |
| twiceler | 314+26 | 4.45 MB | 30 Sep 2009 - 06:56 |
| Unknown robot (identified by hit on 'robots.txt') | 0+306 | 9.26 KB | 30 Sep 2009 - 22:02 |
| Custo | 188+53 | 90.49 MB | 30 Sep 2009 - 13:52 |
| Feedfetcher-Google | 231 | 941.14 KB | 30 Sep 2009 - 22:42 |
| Bloglines | 200 | 814.84 KB | 30 Sep 2009 - 23:32 |
| Python-urllib | 177+2 | 36.51 MB | 29 Sep 2009 - 09:11 |
| Jakarta commons-httpclient | 148+3 | 81.61 MB | 30 Sep 2009 - 22:17 |
| MJ12bot | 117+7 | 1.29 MB | 27 Sep 2009 - 22:27 |
| Unknown robot (identified by empty user agent string) | 90+30 | 36.74 MB | 30 Sep 2009 - 20:23 |
| Exabot | 43+13 | 969.14 KB | 30 Sep 2009 - 09:32 |
| Unknown robot (identified by 'robot') | 33+22 | 19.40 MB | 30 Sep 2009 - 22:00 |
| Harvest | 55 | 1.32 MB | 29 Sep 2009 - 16:36 |
| WordPress | 50 | 19.69 MB | 29 Sep 2009 - 03:59 |
| Java (Often spam bot) | 38+2 | 3.50 MB | 29 Sep 2009 - 20:46 |
| Speedy Spider | 20+14 | 62.89 KB | 29 Sep 2009 - 21:32 |
| Voila | 18+12 | 180.86 KB | 30 Sep 2009 - 16:20 |
| Yandex bot | 15+14 | 1.64 MB | 30 Sep 2009 - 15:04 |
| GigaBot | 11+11 | 74.46 KB | 30 Sep 2009 - 19:16 |
| Nutch | 10+10 | 6.85 MB | 30 Sep 2009 - 04:25 |
| yacy | 9+11 | 4.10 MB | 30 Sep 2009 - 19:28 |
| legs | 0+20 | 620 Bytes | 30 Sep 2009 - 08:51 |
| Unknown robot (identified by 'discovery') | 9+10 | 7.31 MB | 29 Sep 2009 - 03:08 |
| MSIECrawler | 4+15 | 3.65 MB | 29 Sep 2009 - 16:38 |
| FaceBook bot | 11 | 4.27 MB | 29 Sep 2009 - 20:58 |
| larbin | 4+5 | 2.44 MB | 19 Sep 2009 - 05:49 |
| WGet tools | 7 | 1.88 MB | 25 Sep 2009 - 08:36 |
| Voyager | 0+5 | 155 Bytes | 11 Sep 2009 - 06:06 |
| The web archive (IA Archiver) | 0+4 | 124 Bytes | 30 Sep 2009 - 09:23 |
| psbot | 2+2 | 18.27 KB | 05 Sep 2009 - 01:07 |
| CFNetwork | 4 | 2.75 MB | 27 Sep 2009 - 14:54 |
| BBot | 4 | 2.96 MB | 29 Sep 2009 - 20:46 |
| Unknown robot (identified by 'spider') | 1+1 | 1.21 MB | 25 Sep 2009 - 22:40 |
| Turn It In | 0+2 | 62 Bytes | 18 Sep 2009 - 02:54 |
| HTTrack off-line browser | 2 | 353.71 KB | 03 Sep 2009 - 04:26 |
| NG 2.x (Exalead) | 1+1 | 1.21 MB | 05 Sep 2009 - 06:03 |
| TITAN | 1 | 1.21 MB | 25 Sep 2009 - 09:37 |
| Perl tool | 1 | 1.21 MB | 26 Sep 2009 - 03:22 |
| Netcraft | 1 | 6.74 KB | 07 Sep 2009 - 15:13 |
| Sogou Spider | 1 | 93.89 KB | 14 Sep 2009 - 14:50 |