46 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 12718+457 | 17.65 GB | 29 Feb 2008 - 23:29 |
MSNBot | 4656+727 | 448.67 MB | 29 Feb 2008 - 23:49 |
Yahoo Slurp | 3007+173 | 3.00 GB | 29 Feb 2008 - 23:33 |
Googlebot | 2855+25 | 2.00 GB | 29 Feb 2008 - 04:07 |
Heritrix | 1142+4 | 2.00 GB | 24 Feb 2008 - 04:49 |
Unknown robot (identified by 'bot*') | 1091+48 | 544.63 MB | 29 Feb 2008 - 22:02 |
Ask | 485+71 | 5.71 MB | 29 Feb 2008 - 16:50 |
Unknown robot (identified by hit on 'robots.txt') | 0+535 | 5.50 KB | 29 Feb 2008 - 14:18 |
Bloglines | 331 | 1.64 MB | 29 Feb 2008 - 21:38 |
Java (Often spam bot) | 157+1 | 2.29 MB | 27 Feb 2008 - 20:51 |
BaiDuSpider | 104+3 | 3.03 MB | 29 Feb 2008 - 20:07 |
Unknown robot (identified by empty user agent string) | 44+13 | 10.70 MB | 29 Feb 2008 - 21:58 |
Exabot | 35+15 | 257.44 KB | 29 Feb 2008 - 22:07 |
GigaBot | 23+27 | 1.31 MB | 29 Feb 2008 - 23:16 |
MSIECrawler | 0+48 | 3.18 KB | 29 Feb 2008 - 17:46 |
twiceler | 0+41 | 3.52 KB | 28 Feb 2008 - 14:48 |
MSNBot-media | 28+8 | 315.38 KB | 27 Feb 2008 - 06:29 |
Unknown robot (identified by 'robot') | 30+4 | 207.08 KB | 27 Feb 2008 - 12:24 |
Nutch | 19+9 | 1.29 MB | 18 Feb 2008 - 11:41 |
Harvest | 24 | 33.51 KB | 26 Feb 2008 - 15:36 |
Voila | 11+11 | 2.44 MB | 28 Feb 2008 - 12:30 |
MJ12bot | 13+2 | 68.26 KB | 20 Feb 2008 - 21:31 |
archive.org bot | 6+4 | 8.29 MB | 28 Feb 2008 - 18:02 |
Speedy Spider | 5+5 | 3.65 MB | 28 Feb 2008 - 20:06 |
psbot | 4+4 | 23.31 KB | 14 Feb 2008 - 22:12 |
Python-urllib | 0+7 | 616 Bytes | 08 Feb 2008 - 05:49 |
T-H-U-N-D-E-R-S-T-O-N-E | 3+3 | 2.20 MB | 29 Feb 2008 - 13:31 |
Holmes | 4+2 | 1.19 MB | 20 Feb 2008 - 17:49 |
Alexa (IA Archiver) | 3+3 | 15.69 KB | 11 Feb 2008 - 14:37 |
BecomeBot | 2+2 | 30.39 KB | 13 Feb 2008 - 04:08 |
Geniebot | 2+2 | 5.81 KB | 14 Feb 2008 - 09:59 |
Grub.org | 2+2 | 1.39 MB | 09 Feb 2008 - 09:46 |
larbin | 2+2 | 10.46 KB | 21 Feb 2008 - 01:48 |
YahooSeeker Yahoo! Blog crawler | 2+1 | 10.38 KB | 08 Feb 2008 - 16:30 |
yacy | 2+1 | 16.72 KB | 27 Feb 2008 - 09:37 |
OutfoxBot/YodaoBot | 0+2 | 176 Bytes | 20 Feb 2008 - 19:44 |
WGet tools | 2 | 1.22 MB | 17 Feb 2008 - 02:47 |
CFNetwork | 2 | 1.40 MB | 20 Feb 2008 - 21:25 |
BBot | 2 | 84.75 KB | 18 Feb 2008 - 09:19 |
ichiro | 1+1 | 82.28 KB | 16 Feb 2008 - 17:27 |
The web archive (IA Archiver) | 0+1 | 88 Bytes | 27 Feb 2008 - 05:34 |
FaceBook bot | 1 | 1.21 MB | 09 Feb 2008 - 17:55 |
NutchCVS | 0+1 | 88 Bytes | 23 Feb 2008 - 09:00 |
WordPress | 1 | 0 | 01 Feb 2008 - 00:41 |
Sogou Spider | 0+1 | 88 Bytes | 29 Feb 2008 - 04:56 |
Others | 0 | 0 | |