| 46 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 19420+75 | 22.14 GB | 31 Mar 2010 - 23:58 |
| MSNBot | 23444+1774 | 33.61 GB | 31 Mar 2010 - 23:57 |
| Googlebot | 7515+33 | 9.08 GB | 31 Mar 2010 - 23:45 |
| Ask | 660+96 | 183.32 MB | 31 Mar 2010 - 23:40 |
| Feedfetcher-Google | 248 | 1.01 MB | 31 Mar 2010 - 23:06 |
| Python-urllib | 12+1 | 7.44 MB | 31 Mar 2010 - 22:45 |
| Exabot | 48+22 | 6.47 MB | 31 Mar 2010 - 22:27 |
| Unknown robot (identified by 'crawl') | 1162032+751 | 3.99 GB | 31 Mar 2010 - 22:08 |
| Unknown robot (identified by empty user agent string) | 94+58 | 42.71 MB | 31 Mar 2010 - 22:00 |
| Unknown robot (identified by hit on 'robots.txt') | 0+149 | 4.51 KB | 31 Mar 2010 - 21:24 |
| Unknown robot (identified by 'bot*') | 5468+193 | 8.88 GB | 31 Mar 2010 - 21:22 |
| Unknown robot (identified by 'robot') | 107+22 | 48.84 MB | 31 Mar 2010 - 21:11 |
| MSNBot-media | 777+525 | 32.35 MB | 31 Mar 2010 - 20:16 |
| BaiDuSpider | 401+77 | 58.61 MB | 31 Mar 2010 - 19:49 |
| Perl tool | 46 | 2.38 MB | 31 Mar 2010 - 19:35 |
| Bloglines | 215 | 896.74 KB | 31 Mar 2010 - 19:20 |
| Unknown robot (identified by 'discovery') | 32+49 | 14.89 MB | 31 Mar 2010 - 19:13 |
| Jakarta commons-httpclient | 150+3 | 172.48 MB | 31 Mar 2010 - 16:23 |
| twiceler | 49+315 | 74.55 MB | 31 Mar 2010 - 15:39 |
| Custo | 199+61 | 79.09 MB | 31 Mar 2010 - 15:05 |
| Yandex bot | 48+25 | 8.05 MB | 31 Mar 2010 - 10:53 |
| yacy | 5+6 | 3.57 MB | 31 Mar 2010 - 09:57 |
| MSIECrawler | 3+30 | 1.39 MB | 31 Mar 2010 - 04:37 |
| legs | 13+56 | 8.80 MB | 31 Mar 2010 - 04:18 |
| Turn It In | 0+3 | 93 Bytes | 30 Mar 2010 - 23:21 |
| WordPress | 122 | 64.67 MB | 30 Mar 2010 - 18:29 |
| GigaBot | 20+20 | 167.94 KB | 30 Mar 2010 - 18:22 |
| Harvest | 59 | 464.41 KB | 30 Mar 2010 - 16:36 |
| CFNetwork | 15 | 37.15 MB | 30 Mar 2010 - 14:16 |
| Unknown robot (identified by 'spider') | 24+14 | 8.19 MB | 30 Mar 2010 - 13:23 |
| Heritrix | 1411+14 | 2.09 GB | 30 Mar 2010 - 09:18 |
| FaceBook bot | 12 | 11.30 MB | 30 Mar 2010 - 08:32 |
| WGet tools | 18 | 24.01 MB | 29 Mar 2010 - 17:49 |
| Voila | 18+9 | 182.51 KB | 29 Mar 2010 - 15:50 |
| Speedy Spider | 58+46 | 32.58 MB | 28 Mar 2010 - 10:52 |
| Java (Often spam bot) | 33 | 12.97 MB | 25 Mar 2010 - 14:38 |
| T-H-U-N-D-E-R-S-T-O-N-E | 2+1 | 93.92 KB | 24 Mar 2010 - 00:21 |
| The web archive (IA Archiver) | 0+4 | 124 Bytes | 22 Mar 2010 - 19:59 |
| larbin | 1+2 | 6.90 KB | 20 Mar 2010 - 21:02 |
| BBot | 1 | 1.21 MB | 20 Mar 2010 - 03:54 |
| Unknown robot (identified by 'scanner') | 2+2 | 7.53 MB | 16 Mar 2010 - 17:03 |
| EasyDL | 1 | 27.28 KB | 14 Mar 2010 - 01:59 |
| Netcraft | 3 | 13.67 KB | 11 Mar 2010 - 12:06 |
| psbot | 1+1 | 37.48 KB | 08 Mar 2010 - 12:06 |
| Nutch | 2+3 | 1.50 MB | 05 Mar 2010 - 04:40 |
| Others | 0 | 2 Bytes | |