| 51 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 249038+352 | 9.75 GB | 31 Jan 2010 - 23:57 |
| MSNBot | 23486+2208 | 10.28 GB | 31 Jan 2010 - 23:58 |
| Yahoo Slurp | 20611+95 | 28.05 GB | 31 Jan 2010 - 23:59 |
| Googlebot | 13050+34 | 18.97 GB | 31 Jan 2010 - 23:38 |
| Yandex bot | 4665+34 | 8.98 GB | 31 Jan 2010 - 17:07 |
| Python-urllib | 1512 | 1.31 GB | 31 Jan 2010 - 12:11 |
| Ask | 1016+113 | 404.03 MB | 31 Jan 2010 - 23:08 |
| twiceler | 540+274 | 339.24 MB | 31 Jan 2010 - 15:15 |
| Unknown robot (identified by 'bot*') | 426+126 | 388.87 MB | 31 Jan 2010 - 22:58 |
| Exabot | 351+42 | 537.27 MB | 31 Jan 2010 - 12:54 |
| BaiDuSpider | 255+79 | 18.03 MB | 31 Jan 2010 - 22:40 |
| Custo | 207+57 | 122.33 MB | 31 Jan 2010 - 12:23 |
| Java (Often spam bot) | 230+2 | 24.58 MB | 31 Jan 2010 - 18:59 |
| Feedfetcher-Google | 229 | 931.31 KB | 31 Jan 2010 - 23:18 |
| Bloglines | 204 | 831.14 KB | 31 Jan 2010 - 19:00 |
| Unknown robot (identified by empty user agent string) | 132+56 | 80.83 MB | 31 Jan 2010 - 18:01 |
| Speedy Spider | 74+74 | 41.07 MB | 31 Jan 2010 - 21:23 |
| Unknown robot (identified by hit on 'robots.txt') | 0+127 | 3.84 KB | 31 Jan 2010 - 20:58 |
| WGet tools | 122 | 131.74 MB | 28 Jan 2010 - 05:10 |
| Unknown robot (identified by 'robot') | 69+31 | 44.55 MB | 31 Jan 2010 - 02:03 |
| Jakarta commons-httpclient | 87+4 | 20.41 MB | 31 Jan 2010 - 12:11 |
| HTMLParser | 85 | 11.01 MB | 21 Jan 2010 - 01:28 |
| legs | 9+38 | 8.63 MB | 30 Jan 2010 - 01:11 |
| Harvest | 46 | 795.98 KB | 26 Jan 2010 - 15:36 |
| Nutch | 35+10 | 25.04 MB | 27 Jan 2010 - 15:53 |
| Heritrix | 20+13 | 2.33 MB | 15 Jan 2010 - 21:44 |
| yacy | 14+13 | 11.25 MB | 31 Jan 2010 - 08:53 |
| Voila | 16+9 | 152.49 KB | 29 Jan 2010 - 03:24 |
| Unknown robot (identified by 'spider') | 15+7 | 2.92 MB | 24 Jan 2010 - 22:43 |
| Sogou Spider | 2+18 | 10.58 KB | 25 Jan 2010 - 17:12 |
| MSNBot-media | 8+11 | 490.01 KB | 31 Jan 2010 - 04:56 |
| FaceBook bot | 18 | 18.00 MB | 31 Jan 2010 - 20:35 |
| WordPress | 15 | 9.07 MB | 21 Jan 2010 - 22:12 |
| CFNetwork | 14 | 24.84 MB | 30 Jan 2010 - 12:47 |
| Unknown robot (identified by 'discovery') | 4+9 | 2.69 MB | 23 Jan 2010 - 15:34 |
| MJ12bot | 4+3 | 2.13 MB | 27 Jan 2010 - 05:58 |
| Perl tool | 6 | 101.54 KB | 24 Jan 2010 - 20:01 |
| BBot | 6 | 5.73 MB | 23 Jan 2010 - 04:42 |
| The web archive (IA Archiver) | 0+5 | 155 Bytes | 31 Jan 2010 - 20:31 |
| Voyager | 1+4 | 6.86 KB | 23 Jan 2010 - 08:25 |
| MSIECrawler | 1+4 | 6.86 KB | 31 Jan 2010 - 09:54 |
| Feedburner | 4 | 0 | 10 Jan 2010 - 16:48 |
| Netcraft | 3 | 6.74 KB | 31 Jan 2010 - 19:41 |
| ASpider (Associative Spider) | 2 | 2.43 MB | 20 Jan 2010 - 08:40 |
| Spiderman | 1+1 | 6.77 KB | 02 Jan 2010 - 04:26 |
| larbin | 1+1 | 6.77 KB | 03 Jan 2010 - 02:02 |
| VORTEX | 2 | 13.48 KB | 08 Jan 2010 - 08:53 |
| Turn It In | 0+1 | 31 Bytes | 18 Jan 2010 - 06:45 |
| DoCoMo | 0+1 | 31 Bytes | 14 Jan 2010 - 04:10 |
| HTTrack off-line browser | 1 | 1.21 MB | 23 Jan 2010 - 07:08 |
| StackRambler | 0+1 | 31 Bytes | 15 Jan 2010 - 09:56 |