| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 13966+627 | 2.49 GB | 31 Oct 2006 - 23:56 |
| Yahoo Slurp | 3633+791 | 7.27 GB | 31 Oct 2006 - 23:57 |
| Googlebot | 3612+30 | 9.32 GB | 31 Oct 2006 - 19:52 |
| Heritrix | 3202+2 | 7.31 GB | 03 Oct 2006 - 20:21 |
| Java (Often spam bot) | 1033 | 7.45 MB | 31 Oct 2006 - 23:40 |
| ConveraCrawler | 651+3 | 1.27 GB | 27 Oct 2006 - 12:01 |
| Unknown robot (identified by 'bot*') | 520+32 | 18.59 MB | 31 Oct 2006 - 08:56 |
| LinkChecker | 246+1 | 1.91 MB | 19 Oct 2006 - 21:13 |
| MSNBot | 62+69 | 5.49 MB | 31 Oct 2006 - 16:36 |
| Ask | 81+31 | 1.11 MB | 31 Oct 2006 - 09:34 |
| Unknown robot (identified by empty user agent string) | 58+25 | 49.26 MB | 31 Oct 2006 - 11:05 |
| MSNBot-media | 36+9 | 313.39 KB | 29 Oct 2006 - 11:00 |
| Unknown robot (identified by hit on 'robots.txt') | 0+41 | 3.52 KB | 31 Oct 2006 - 19:45 |
| Exabot | 25+13 | 298.97 KB | 31 Oct 2006 - 05:54 |
| Findlinks | 23+9 | 169.27 KB | 30 Oct 2006 - 16:53 |
| Sina Iask Spider | 25 | 128.61 KB | 31 Oct 2006 - 05:19 |
| NutchCVS | 17+3 | 9.17 MB | 15 Oct 2006 - 12:02 |
| Harvest | 20 | 27.92 KB | 31 Oct 2006 - 15:36 |
| Sogou Spider | 16+4 | 63.71 KB | 24 Oct 2006 - 21:13 |
| Shim-Crawler | 15+3 | 76.60 KB | 19 Oct 2006 - 08:06 |
| MSRBOT | 7+5 | 11.49 MB | 13 Oct 2006 - 13:45 |
| Perl tool | 11 | 72.89 KB | 29 Oct 2006 - 01:16 |
| Custo | 8 | 841.61 KB | 20 Oct 2006 - 13:36 |
| BaiDuSpider | 3+5 | 10.72 KB | 26 Oct 2006 - 12:55 |
| Python-urllib | 6 | 864.99 KB | 18 Oct 2006 - 08:35 |
| Netcraft | 6 | 0 | 30 Oct 2006 - 21:01 |
| Girafabot | 3+2 | 13.80 KB | 15 Oct 2006 - 16:07 |
| GigaBot | 2+3 | 99.29 KB | 20 Oct 2006 - 00:32 |
| Jakarta commons-httpclient | 4 | 3.92 MB | 19 Oct 2006 - 22:07 |
| WGet tools | 3+1 | 133.19 KB | 26 Oct 2006 - 05:50 |
| Unknown robot (identified by 'robot') | 2+2 | 5.75 KB | 21 Oct 2006 - 03:02 |
| ZyBorg | 1+2 | 5.32 KB | 29 Oct 2006 - 13:41 |
| Seekbot | 2+1 | 1.23 MB | 05 Oct 2006 - 06:16 |
| MJ12bot | 2+1 | 7.74 KB | 13 Oct 2006 - 11:00 |
| Cfetch | 2 | 0 | 31 Oct 2006 - 12:13 |
| HTTrack off-line browser | 1+1 | 5.23 KB | 19 Oct 2006 - 14:09 |
| WordPress | 2 | 0 | 16 Oct 2006 - 12:19 |
| SuperBot | 1 | 1.21 MB | 14 Oct 2006 - 22:44 |
| Walhello appie | 0+1 | 88 Bytes | 04 Oct 2006 - 03:57 |
| CFNetwork | 1 | 113.31 KB | 24 Oct 2006 - 14:00 |
| nicebot | 1 | 11.13 KB | 27 Oct 2006 - 11:22 |
| Voyager | 0+1 | 88 Bytes | 29 Oct 2006 - 18:49 |