| 44 different robots | Hits | Bandwidth | Last visit |
|---|
| MSNBot | 10009+596 | 11.89 GB | 31 Jul 2009 - 23:59 |
| Googlebot | 3438+16 | 6.16 GB | 31 Jul 2009 - 23:57 |
| Yahoo Slurp | 6523+75 | 10.25 GB | 31 Jul 2009 - 23:57 |
| Ask | 689+56 | 96.78 MB | 31 Jul 2009 - 23:54 |
| Bloglines | 93 | 378.90 KB | 31 Jul 2009 - 23:35 |
| Unknown robot (identified by hit on 'robots.txt') | 0+99 | 3.00 KB | 31 Jul 2009 - 22:35 |
| BaiDuSpider | 173+19 | 5.49 MB | 31 Jul 2009 - 22:23 |
| FaceBook bot | 4 | 3.68 MB | 31 Jul 2009 - 22:21 |
| Feedfetcher-Google | 2 | 74.90 KB | 31 Jul 2009 - 22:21 |
| Python-urllib | 46 | 20.45 MB | 31 Jul 2009 - 22:13 |
| Unknown robot (identified by 'crawl') | 92657+267 | 2.98 GB | 31 Jul 2009 - 22:01 |
| Yandex bot | 3+4 | 20.34 KB | 31 Jul 2009 - 21:57 |
| Unknown robot (identified by 'bot*') | 818+9 | 114.88 MB | 31 Jul 2009 - 20:55 |
| Unknown robot (identified by empty user agent string) | 36+15 | 14.71 MB | 31 Jul 2009 - 19:28 |
| Sogou Spider | 8 | 2.91 MB | 31 Jul 2009 - 18:27 |
| WordPress | 5 | 4.86 MB | 31 Jul 2009 - 13:45 |
| Custo | 61+24 | 53.22 MB | 31 Jul 2009 - 13:40 |
| Unknown robot (identified by 'robot') | 4+6 | 1.42 MB | 31 Jul 2009 - 12:29 |
| StackRambler | 0+1 | 31 Bytes | 31 Jul 2009 - 12:27 |
| twiceler | 993+14 | 42.51 MB | 31 Jul 2009 - 10:23 |
| Exabot | 20+6 | 636.50 KB | 31 Jul 2009 - 07:00 |
| GigaBot | 8+8 | 343.60 KB | 31 Jul 2009 - 06:02 |
| Voila | 10+5 | 103.74 KB | 31 Jul 2009 - 03:29 |
| larbin | 10+6 | 148.61 KB | 30 Jul 2009 - 23:18 |
| WGet tools | 4 | 0 | 30 Jul 2009 - 22:15 |
| Speedy Spider | 9+8 | 3.66 MB | 30 Jul 2009 - 20:32 |
| Yahoo-MMCrawler | 145+2 | 15.90 MB | 30 Jul 2009 - 16:17 |
| MSIECrawler | 0+9 | 279 Bytes | 30 Jul 2009 - 16:15 |
| Jakarta commons-httpclient | 5+1 | 1.64 MB | 30 Jul 2009 - 15:35 |
| Java (Often spam bot) | 4+2 | 1.73 MB | 30 Jul 2009 - 06:27 |
| Perl tool | 19 | 2.68 MB | 29 Jul 2009 - 09:59 |
| Harvest | 18 | 53.78 KB | 28 Jul 2009 - 16:36 |
| Unknown robot (identified by 'discovery') | 10+17 | 41.57 KB | 28 Jul 2009 - 11:59 |
| Heritrix | 2+2 | 2.43 MB | 25 Jul 2009 - 22:28 |
| Nutch | 4+6 | 88.49 KB | 25 Jul 2009 - 18:47 |
| ichiro | 1+1 | 6.77 KB | 25 Jul 2009 - 16:20 |
| CFNetwork | 1 | 291.33 KB | 25 Jul 2009 - 13:01 |
| VORTEX | 4 | 26.96 KB | 24 Jul 2009 - 16:50 |
| psbot | 6+1 | 180.11 KB | 24 Jul 2009 - 07:02 |
| HTTrack off-line browser | 1 | 1.21 MB | 23 Jul 2009 - 14:53 |
| OutfoxBot/YodaoBot | 1+1 | 6.77 KB | 22 Jul 2009 - 17:58 |
| legs | 1+3 | 810.38 KB | 22 Jul 2009 - 11:43 |
| Turn It In | 0+3 | 93 Bytes | 20 Jul 2009 - 14:36 |
| yacy | 1+1 | 3.77 MB | 19 Jul 2009 - 03:52 |