| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 11529+699 | 2.66 GB | 31 Jul 2007 - 23:56 |
| MSNBot | 4212+609 | 6.68 GB | 31 Jul 2007 - 23:56 |
| Yahoo Slurp | 8030+168 | 8.27 GB | 31 Jul 2007 - 23:54 |
| Unknown robot (identified by 'bot*') | 1037+28 | 168.32 MB | 31 Jul 2007 - 20:57 |
| Ask | 345+41 | 13.67 MB | 31 Jul 2007 - 20:03 |
| Googlebot | 1763+27 | 2.33 GB | 31 Jul 2007 - 20:02 |
| Harvest | 23 | 866.67 KB | 31 Jul 2007 - 16:36 |
| Unknown robot (identified by empty user agent string) | 61+14 | 2.27 MB | 31 Jul 2007 - 13:56 |
| MSIECrawler | 1+17 | 38.74 KB | 31 Jul 2007 - 13:39 |
| Voila | 12+12 | 186.00 KB | 31 Jul 2007 - 11:18 |
| Unknown robot (identified by hit on 'robots.txt') | 0+34 | 2.92 KB | 31 Jul 2007 - 06:13 |
| Java (Often spam bot) | 115 | 4.81 MB | 31 Jul 2007 - 02:10 |
| twiceler | 0+9 | 792 Bytes | 30 Jul 2007 - 19:36 |
| WGet tools | 8+1 | 2.44 MB | 30 Jul 2007 - 08:46 |
| NutchCVS | 4+4 | 4.22 MB | 30 Jul 2007 - 08:29 |
| FaceBook bot | 1 | 1.21 MB | 30 Jul 2007 - 07:23 |
| Nutch | 17+21 | 12.62 MB | 30 Jul 2007 - 05:27 |
| Jakarta commons-httpclient | 11+1 | 15.51 MB | 29 Jul 2007 - 19:20 |
| nicebot | 2+2 | 8.85 KB | 28 Jul 2007 - 12:36 |
| Heritrix | 2873+6 | 5.26 GB | 28 Jul 2007 - 03:52 |
| CFNetwork | 1 | 1.21 MB | 27 Jul 2007 - 22:20 |
| GigaBot | 2+2 | 1.60 MB | 27 Jul 2007 - 17:19 |
| Unknown robot (identified by 'robot') | 1+1 | 533 Bytes | 27 Jul 2007 - 06:49 |
| BaiDuSpider | 2 | 0 | 26 Jul 2007 - 21:21 |
| MJ12bot | 4+3 | 31.06 KB | 26 Jul 2007 - 20:01 |
| Speedy Spider | 7+2 | 8.50 MB | 25 Jul 2007 - 20:34 |
| IRLbot | 10+1 | 29.53 KB | 25 Jul 2007 - 07:38 |
| Exabot | 6+5 | 44.19 KB | 23 Jul 2007 - 06:12 |
| MSNBot-media | 21+12 | 309.33 KB | 22 Jul 2007 - 20:10 |
| archive.org bot | 50+3 | 950.35 KB | 20 Jul 2007 - 02:54 |
| larbin | 2+2 | 10.46 KB | 19 Jul 2007 - 17:21 |
| LinkChecker | 11+1 | 34.67 KB | 19 Jul 2007 - 16:10 |
| lwp-trivial | 1 | 5.14 KB | 18 Jul 2007 - 06:37 |
| BecomeBot | 1+1 | 5.23 KB | 17 Jul 2007 - 00:45 |
| Perl tool | 1 | 5.14 KB | 12 Jul 2007 - 13:45 |
| ichiro | 1+1 | 82.28 KB | 12 Jul 2007 - 10:49 |
| Sogou Spider | 4+1 | 1.85 MB | 11 Jul 2007 - 22:58 |
| boitho.com-dc | 1+1 | 2.78 KB | 09 Jul 2007 - 11:04 |
| Seekbot | 1+1 | 11.57 KB | 06 Jul 2007 - 16:22 |
| YahooSeeker Yahoo! Blog crawler | 1 | 93.89 KB | 06 Jul 2007 - 02:32 |
| yacy | 2+1 | 5.67 KB | 02 Jul 2007 - 08:34 |
| Cfetch | 1 | 0 | 02 Jul 2007 - 07:08 |
| Others | 0 | 0 | |