51 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 20611+95 | 28.05 GB | 31 Jan 2010 - 23:59 |
MSNBot | 23486+2208 | 10.28 GB | 31 Jan 2010 - 23:58 |
Unknown robot (identified by 'crawl') | 249038+352 | 9.75 GB | 31 Jan 2010 - 23:57 |
Googlebot | 13050+34 | 18.97 GB | 31 Jan 2010 - 23:38 |
Feedfetcher-Google | 229 | 931.31 KB | 31 Jan 2010 - 23:18 |
Ask | 1016+113 | 404.03 MB | 31 Jan 2010 - 23:08 |
Unknown robot (identified by 'bot*') | 426+126 | 388.87 MB | 31 Jan 2010 - 22:58 |
BaiDuSpider | 255+79 | 18.03 MB | 31 Jan 2010 - 22:40 |
Speedy Spider | 74+74 | 41.07 MB | 31 Jan 2010 - 21:23 |
Unknown robot (identified by hit on 'robots.txt') | 0+127 | 3.84 KB | 31 Jan 2010 - 20:58 |
FaceBook bot | 18 | 18.00 MB | 31 Jan 2010 - 20:35 |
The web archive (IA Archiver) | 0+5 | 155 Bytes | 31 Jan 2010 - 20:31 |
Netcraft | 3 | 6.74 KB | 31 Jan 2010 - 19:41 |
Bloglines | 204 | 831.14 KB | 31 Jan 2010 - 19:00 |
Java (Often spam bot) | 230+2 | 24.58 MB | 31 Jan 2010 - 18:59 |
Unknown robot (identified by empty user agent string) | 132+56 | 80.83 MB | 31 Jan 2010 - 18:01 |
Yandex bot | 4665+34 | 8.98 GB | 31 Jan 2010 - 17:07 |
twiceler | 540+274 | 339.24 MB | 31 Jan 2010 - 15:15 |
Exabot | 351+42 | 537.27 MB | 31 Jan 2010 - 12:54 |
Custo | 207+57 | 122.33 MB | 31 Jan 2010 - 12:23 |
Python-urllib | 1512 | 1.31 GB | 31 Jan 2010 - 12:11 |
Jakarta commons-httpclient | 87+4 | 20.41 MB | 31 Jan 2010 - 12:11 |
MSIECrawler | 1+4 | 6.86 KB | 31 Jan 2010 - 09:54 |
yacy | 14+13 | 11.25 MB | 31 Jan 2010 - 08:53 |
MSNBot-media | 8+11 | 490.01 KB | 31 Jan 2010 - 04:56 |
Unknown robot (identified by 'robot') | 69+31 | 44.55 MB | 31 Jan 2010 - 02:03 |
CFNetwork | 14 | 24.84 MB | 30 Jan 2010 - 12:47 |
legs | 9+38 | 8.63 MB | 30 Jan 2010 - 01:11 |
Voila | 16+9 | 152.49 KB | 29 Jan 2010 - 03:24 |
WGet tools | 122 | 131.74 MB | 28 Jan 2010 - 05:10 |
Nutch | 35+10 | 25.04 MB | 27 Jan 2010 - 15:53 |
MJ12bot | 4+3 | 2.13 MB | 27 Jan 2010 - 05:58 |
Harvest | 46 | 795.98 KB | 26 Jan 2010 - 15:36 |
Sogou Spider | 2+18 | 10.58 KB | 25 Jan 2010 - 17:12 |
Unknown robot (identified by 'spider') | 15+7 | 2.92 MB | 24 Jan 2010 - 22:43 |
Perl tool | 6 | 101.54 KB | 24 Jan 2010 - 20:01 |
Unknown robot (identified by 'discovery') | 4+9 | 2.69 MB | 23 Jan 2010 - 15:34 |
Voyager | 1+4 | 6.86 KB | 23 Jan 2010 - 08:25 |
HTTrack off-line browser | 1 | 1.21 MB | 23 Jan 2010 - 07:08 |
BBot | 6 | 5.73 MB | 23 Jan 2010 - 04:42 |
WordPress | 15 | 9.07 MB | 21 Jan 2010 - 22:12 |
HTMLParser | 85 | 11.01 MB | 21 Jan 2010 - 01:28 |
ASpider (Associative Spider) | 2 | 2.43 MB | 20 Jan 2010 - 08:40 |
Turn It In | 0+1 | 31 Bytes | 18 Jan 2010 - 06:45 |
Heritrix | 20+13 | 2.33 MB | 15 Jan 2010 - 21:44 |
StackRambler | 0+1 | 31 Bytes | 15 Jan 2010 - 09:56 |
DoCoMo | 0+1 | 31 Bytes | 14 Jan 2010 - 04:10 |
Feedburner | 4 | 0 | 10 Jan 2010 - 16:48 |
VORTEX | 2 | 13.48 KB | 08 Jan 2010 - 08:53 |
larbin | 1+1 | 6.77 KB | 03 Jan 2010 - 02:02 |
Spiderman | 1+1 | 6.77 KB | 02 Jan 2010 - 04:26 |