| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 9740+682 | 2.51 GB | 30 Nov 2007 - 23:43 |
| Googlebot | 4469+26 | 11.48 GB | 30 Nov 2007 - 23:40 |
| Yahoo Slurp | 3243+98 | 3.56 GB | 30 Nov 2007 - 23:52 |
| MSNBot | 2404+738 | 1.38 GB | 30 Nov 2007 - 23:35 |
| Heritrix | 2655+16 | 4.31 GB | 30 Nov 2007 - 09:29 |
| Nutch | 760+72 | 21.17 MB | 30 Nov 2007 - 18:05 |
| Bloglines | 415 | 2.06 MB | 30 Nov 2007 - 21:52 |
| Ask | 238+22 | 2.12 MB | 30 Nov 2007 - 23:17 |
| twiceler | 0+165 | 14.18 KB | 27 Nov 2007 - 17:48 |
| Unknown robot (identified by 'bot*') | 115+48 | 43.50 MB | 30 Nov 2007 - 12:43 |
| Unknown robot (identified by hit on 'robots.txt') | 0+132 | 6.02 KB | 30 Nov 2007 - 18:54 |
| Java (Often spam bot) | 106 | 2.06 MB | 30 Nov 2007 - 15:40 |
| MSNBot-media | 66+23 | 670.82 KB | 29 Nov 2007 - 16:34 |
| Unknown robot (identified by 'robot') | 45+31 | 671.02 KB | 29 Nov 2007 - 07:29 |
| GigaBot | 57+18 | 791.51 KB | 23 Nov 2007 - 09:52 |
| MSIECrawler | 5+62 | 4.19 MB | 30 Nov 2007 - 03:13 |
| Unknown robot (identified by empty user agent string) | 50+6 | 6.60 MB | 30 Nov 2007 - 08:12 |
| BaiDuSpider | 49+4 | 1.39 MB | 30 Nov 2007 - 20:06 |
| MSRBOT | 31+18 | 4.42 MB | 24 Nov 2007 - 07:23 |
| MJ12bot | 33+5 | 41.27 MB | 17 Nov 2007 - 06:15 |
| NG 2.x (Exalead) | 17+5 | 88.87 KB | 26 Nov 2007 - 23:52 |
| Harvest | 19 | 861.04 KB | 27 Nov 2007 - 15:36 |
| ichiro | 13+1 | 133.82 KB | 28 Nov 2007 - 17:03 |
| Speedy Spider | 4+4 | 2.44 MB | 28 Nov 2007 - 02:50 |
| Voila | 3+3 | 169.79 KB | 26 Nov 2007 - 15:14 |
| Exabot | 3+3 | 27.81 KB | 16 Nov 2007 - 03:09 |
| Holmes | 3+1 | 15.97 KB | 26 Nov 2007 - 09:30 |
| BecomeBot | 2+2 | 10.46 KB | 18 Nov 2007 - 14:25 |
| archive.org bot | 2+2 | 2.12 MB | 29 Nov 2007 - 05:59 |
| QihooBot | 4 | 1.23 MB | 29 Nov 2007 - 14:25 |
| Sogou Spider | 2+2 | 194.46 KB | 15 Nov 2007 - 17:58 |
| Cfetch | 3 | 0 | 24 Nov 2007 - 12:44 |
| OutfoxBot/YodaoBot | 1+2 | 176 Bytes | 28 Nov 2007 - 23:48 |
| Steeler | 2+1 | 5.67 KB | 05 Nov 2007 - 20:04 |
| The web archive (IA Archiver) | 0+2 | 176 Bytes | 21 Nov 2007 - 05:53 |
| CFNetwork | 2 | 22.14 MB | 22 Nov 2007 - 14:59 |
| boitho.com-dc | 0+1 | 88 Bytes | 30 Nov 2007 - 11:01 |
| WGet tools | 1 | 1.69 KB | 28 Nov 2007 - 10:53 |
| Unknown robot (identified by 'hunter') | 0+1 | 88 Bytes | 21 Nov 2007 - 19:30 |
| yacy | 0+1 | 88 Bytes | 11 Nov 2007 - 19:34 |
| Internet Shinchakubin | 1 | 115.21 KB | 26 Nov 2007 - 12:19 |