| 55 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 678092+717 | 13.93 GB | 31 May 2010 - 21:13 |
| Yahoo Slurp | 18172+99 | 18.81 GB | 31 May 2010 - 23:58 |
| MSNBot | 13713+708 | 13.29 GB | 31 May 2010 - 23:59 |
| Googlebot | 8546+33 | 9.38 GB | 31 May 2010 - 23:58 |
| Unknown robot (identified by 'bot*') | 3213+127 | 1.76 GB | 31 May 2010 - 12:17 |
| twiceler | 1771+560 | 5.94 GB | 31 May 2010 - 23:55 |
| MSNBot-media | 923+440 | 39.39 MB | 31 May 2010 - 21:28 |
| Unknown robot (identified by 'robot') | 977+25 | 31.71 MB | 29 May 2010 - 19:13 |
| Python-urllib | 968+1 | 1.10 GB | 31 May 2010 - 17:08 |
| Perl tool | 939 | 1.09 GB | 30 May 2010 - 18:19 |
| Yandex bot | 698+26 | 215.92 MB | 31 May 2010 - 19:27 |
| Ask | 502+202 | 135.94 MB | 31 May 2010 - 15:32 |
| Unknown robot (identified by 'discovery') | 491+101 | 50.57 MB | 31 May 2010 - 19:33 |
| BaiDuSpider | 410+79 | 68.16 MB | 31 May 2010 - 23:01 |
| Unknown robot (identified by 'spider') | 443+9 | 5.03 MB | 29 May 2010 - 09:40 |
| Unknown robot (identified by empty user agent string) | 344+58 | 134.98 MB | 31 May 2010 - 22:25 |
| Custo | 177+58 | 155.09 MB | 31 May 2010 - 15:17 |
| Bloglines | 215 | 896.74 KB | 31 May 2010 - 23:24 |
| Unknown robot (identified by hit on 'robots.txt') | 0+209 | 6.27 KB | 31 May 2010 - 20:39 |
| Jakarta commons-httpclient | 134+3 | 122.78 MB | 31 May 2010 - 08:45 |
| MJ12bot | 111+6 | 2.72 MB | 30 May 2010 - 09:42 |
| Nutch | 73+27 | 61.34 MB | 28 May 2010 - 13:39 |
| yacy | 58+15 | 15.60 MB | 30 May 2010 - 18:54 |
| Speedy Spider | 36+34 | 10.78 MB | 31 May 2010 - 11:06 |
| Exabot | 43+16 | 308.70 MB | 28 May 2010 - 08:57 |
| Java (Often spam bot) | 56+1 | 27.93 MB | 30 May 2010 - 11:03 |
| Harvest | 56 | 949.17 KB | 31 May 2010 - 01:21 |
| legs | 16+35 | 13.54 MB | 30 May 2010 - 18:10 |
| Voyager | 33 | 38.91 MB | 31 May 2010 - 12:16 |
| WordPress | 28 | 6.11 MB | 30 May 2010 - 16:32 |
| GigaBot | 16+10 | 97.45 KB | 14 May 2010 - 09:15 |
| CFNetwork | 23 | 24.46 MB | 27 May 2010 - 08:45 |
| MSIECrawler | 1+17 | 37.69 KB | 29 May 2010 - 20:37 |
| NG 1.x (Exalead) | 14 | 2.54 MB | 26 May 2010 - 06:07 |
| WGet tools | 14 | 12.61 MB | 30 May 2010 - 11:04 |
| FaceBook bot | 10 | 11.32 MB | 30 May 2010 - 16:07 |
| psbot | 5+5 | 56.30 KB | 31 May 2010 - 20:42 |
| Heritrix | 3+3 | 3.90 MB | 31 May 2010 - 18:37 |
| Voila | 1+4 | 6.96 KB | 26 May 2010 - 08:12 |
| larbin | 2+3 | 44.38 KB | 25 May 2010 - 14:14 |
| Unknown robot (identified by '*bot') | 4 | 761.97 KB | 13 May 2010 - 08:22 |
| Unknown robot (identified by 'scanner') | 2+2 | 7.53 MB | 28 May 2010 - 01:13 |
| BBot | 4 | 4.52 MB | 18 May 2010 - 03:36 |
| Sogou Spider | 1+3 | 5.29 KB | 23 May 2010 - 00:26 |
| The web archive (IA Archiver) | 0+3 | 93 Bytes | 25 May 2010 - 07:24 |
| T-H-U-N-D-E-R-S-T-O-N-E | 2+1 | 93.92 KB | 05 May 2010 - 01:05 |
| HTMLParser | 3 | 3.64 MB | 22 May 2010 - 11:09 |
| Hometown Spider Pro | 3 | 176.63 KB | 06 May 2010 - 13:42 |
| HTTrack off-line browser | 3 | 2.30 MB | 31 May 2010 - 07:10 |
| Netcraft | 3 | 6.84 KB | 31 May 2010 - 20:01 |
| W3C Link Checker | 1+1 | 31 Bytes | 03 May 2010 - 15:42 |
| EasyDL | 1 | 93.89 KB | 28 May 2010 - 03:34 |
| Digger | 1 | 6.84 KB | 10 May 2010 - 10:42 |
| Gaisbot | 1 | 6.84 KB | 17 May 2010 - 17:52 |
| lwp-trivial | 1 | 37.45 KB | 01 May 2010 - 00:18 |