| 44 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 17713+73 | 16.62 GB | 31 Aug 2010 - 23:55 |
| MSNBot | 3236+1317 | 1.87 GB | 31 Aug 2010 - 23:46 |
| Ask | 805+104 | 425.30 MB | 31 Aug 2010 - 23:40 |
| Bloglines | 231 | 982.65 KB | 31 Aug 2010 - 23:36 |
| Googlebot | 14117+31 | 13.55 GB | 31 Aug 2010 - 23:18 |
| BaiDuSpider | 482+78 | 122.44 MB | 31 Aug 2010 - 23:11 |
| Unknown robot (identified by hit on 'robots.txt') | 0+91 | 2.69 KB | 31 Aug 2010 - 23:01 |
| Sogou Spider | 2+15 | 12.37 KB | 31 Aug 2010 - 22:05 |
| WordPress | 60 | 14.64 MB | 31 Aug 2010 - 21:25 |
| Unknown robot (identified by 'crawl') | 712840+1056 | 8.06 GB | 31 Aug 2010 - 20:34 |
| Yandex bot | 269+21 | 447.95 MB | 31 Aug 2010 - 18:51 |
| Netcraft | 4 | 7.02 KB | 31 Aug 2010 - 18:34 |
| yacy | 10+3 | 3.17 MB | 31 Aug 2010 - 17:27 |
| Speedy Spider | 102+86 | 22.01 MB | 31 Aug 2010 - 17:26 |
| Exabot | 36+15 | 443.88 KB | 31 Aug 2010 - 17:20 |
| Unknown robot (identified by 'bot*') | 1580+82 | 1.73 GB | 31 Aug 2010 - 17:13 |
| Harvest | 75 | 1.77 MB | 31 Aug 2010 - 16:36 |
| Custo | 167+42 | 61.81 MB | 31 Aug 2010 - 15:38 |
| MSNBot-media | 751+304 | 45.82 MB | 31 Aug 2010 - 14:33 |
| The web archive (IA Archiver) | 0+6 | 186 Bytes | 31 Aug 2010 - 14:07 |
| Unknown robot (identified by empty user agent string) | 521+29 | 363.39 MB | 31 Aug 2010 - 12:55 |
| Java (Often spam bot) | 17 | 3.33 MB | 30 Aug 2010 - 17:30 |
| Unknown robot (identified by 'spider') | 15+9 | 4.21 MB | 30 Aug 2010 - 16:26 |
| MJ12bot | 3+2 | 61.25 KB | 30 Aug 2010 - 07:55 |
| Nutch | 27+5 | 277.72 KB | 29 Aug 2010 - 10:19 |
| WGet tools | 17 | 18.96 MB | 29 Aug 2010 - 07:29 |
| Python-urllib | 9 | 8.38 MB | 28 Aug 2010 - 17:42 |
| FavIconizer | 2 | 14.03 KB | 28 Aug 2010 - 13:54 |
| Voila | 0+4 | 124 Bytes | 27 Aug 2010 - 18:39 |
| QihooBot | 1 | 7.02 KB | 27 Aug 2010 - 06:17 |
| legs | 0+9 | 279 Bytes | 26 Aug 2010 - 13:17 |
| Jakarta commons-httpclient | 27 | 3.71 MB | 26 Aug 2010 - 08:06 |
| Perl tool | 7 | 59.36 KB | 25 Aug 2010 - 19:45 |
| CFNetwork | 7 | 7.33 MB | 25 Aug 2010 - 12:45 |
| Unknown robot (identified by 'robot') | 678+14 | 8.27 MB | 25 Aug 2010 - 01:16 |
| HTMLParser | 1 | 176.86 KB | 24 Aug 2010 - 14:22 |
| Heritrix | 979+5 | 99.67 MB | 24 Aug 2010 - 14:01 |
| WallPaper (alias crawlpaper) | 1 | 644.24 KB | 24 Aug 2010 - 07:43 |
| MSIECrawler | 0+4 | 124 Bytes | 13 Aug 2010 - 18:27 |
| Unknown robot (identified by 'discovery') | 3+4 | 4.80 MB | 13 Aug 2010 - 06:12 |
| Unknown robot (identified by 'scanner') | 3+3 | 6.20 MB | 10 Aug 2010 - 20:34 |
| VSE | 1+1 | 7.05 KB | 10 Aug 2010 - 07:44 |
| archive.org bot | 1674+6 | 1.06 GB | 07 Aug 2010 - 01:08 |
| SPIP | 1+1 | 31 Bytes | 06 Aug 2010 - 16:43 |