| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 16899+1694 | 23.62 GB | 30 Apr 2008 - 23:59 |
| Unknown robot (identified by 'crawl') | 11112+710 | 5.07 GB | 30 Apr 2008 - 23:50 |
| Googlebot | 7382+27 | 6.13 GB | 30 Apr 2008 - 22:29 |
| MSNBot | 6348+382 | 799.85 MB | 30 Apr 2008 - 23:59 |
| Java (Often spam bot) | 691+1 | 7.88 MB | 29 Apr 2008 - 00:22 |
| Unknown robot (identified by hit on 'robots.txt') | 0+503 | 42.80 KB | 30 Apr 2008 - 09:40 |
| Bloglines | 489 | 2.43 MB | 30 Apr 2008 - 23:07 |
| Heritrix | 366+3 | 10.45 MB | 16 Apr 2008 - 01:05 |
| Unknown robot (identified by 'bot*') | 206+129 | 589.92 MB | 30 Apr 2008 - 20:54 |
| Ask | 137+47 | 2.60 MB | 30 Apr 2008 - 06:44 |
| BaiDuSpider | 119+6 | 412.08 KB | 30 Apr 2008 - 23:45 |
| yacy | 52+26 | 12.63 MB | 25 Apr 2008 - 23:32 |
| MSNBot-media | 57+12 | 479.34 KB | 22 Apr 2008 - 07:39 |
| Unknown robot (identified by empty user agent string) | 38+16 | 9.53 MB | 30 Apr 2008 - 13:59 |
| Exabot | 40+14 | 273.14 KB | 30 Apr 2008 - 02:57 |
| Unknown robot (identified by 'discovery') | 43+7 | 108.79 MB | 28 Apr 2008 - 19:25 |
| larbin | 28+9 | 180.64 KB | 30 Apr 2008 - 02:07 |
| MSIECrawler | 5+30 | 1.23 MB | 30 Apr 2008 - 14:16 |
| Voila | 17+16 | 5.15 MB | 29 Apr 2008 - 13:13 |
| twiceler | 0+33 | 2.84 KB | 28 Apr 2008 - 21:21 |
| Nutch | 17+9 | 1.54 MB | 24 Apr 2008 - 02:33 |
| Harvest | 25 | 872.29 KB | 29 Apr 2008 - 16:36 |
| GigaBot | 13+9 | 354.62 KB | 26 Apr 2008 - 08:08 |
| Unknown robot (identified by 'robot') | 11+10 | 4.15 MB | 30 Apr 2008 - 15:57 |
| BBot | 14 | 600.32 KB | 30 Apr 2008 - 16:58 |
| Jakarta commons-httpclient | 0+12 | 528 Bytes | 25 Apr 2008 - 23:33 |
| archive.org bot | 7+5 | 11.72 MB | 13 Apr 2008 - 23:06 |
| Holmes | 1+6 | 115.82 KB | 28 Apr 2008 - 10:48 |
| BSpider | 0+5 | 440 Bytes | 22 Apr 2008 - 23:38 |
| Unknown robot (identified by 'spider') | 2+2 | 10.46 KB | 18 Apr 2008 - 03:01 |
| MJ12bot | 2+2 | 17.56 KB | 22 Apr 2008 - 15:53 |
| Sogou Spider | 2+1 | 5.23 KB | 29 Apr 2008 - 09:20 |
| WGet tools | 2 | 1.19 MB | 30 Apr 2008 - 04:26 |
| Seekbot | 1+1 | 11.57 KB | 04 Apr 2008 - 21:14 |
| CFNetwork | 2 | 1.55 MB | 15 Apr 2008 - 05:46 |
| Spiderman | 1+1 | 1.21 MB | 15 Apr 2008 - 12:26 |
| EasyDL | 1 | 31.67 KB | 18 Apr 2008 - 06:13 |
| OutfoxBot/YodaoBot | 0+1 | 88 Bytes | 10 Apr 2008 - 19:32 |
| Pioneer | 1 | 4.05 MB | 19 Apr 2008 - 09:01 |
| WordPress | 1 | 961.22 KB | 07 Apr 2008 - 02:11 |
| NG 2.x (Exalead) | 0+1 | 88 Bytes | 14 Apr 2008 - 14:05 |
| Others | 0 | 0 | |