57 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 1177730+38132 | 9.56 GB | 31 Mar 2012 - 23:59 |
Googlebot | 51967+34 | 30.86 GB | 31 Mar 2012 - 23:57 |
Unknown robot (identified by 'bot*') | 19309+469 | 5.98 GB | 31 Mar 2012 - 23:59 |
Yandex bot | 16970+41 | 10.93 GB | 31 Mar 2012 - 23:55 |
Heritrix | 6057+10 | 102.50 MB | 30 Mar 2012 - 15:57 |
Python-urllib | 2093 | 3.86 GB | 29 Mar 2012 - 14:42 |
psbot | 1534+37 | 19.21 MB | 26 Mar 2012 - 06:00 |
Unknown robot (identified by empty user agent string) | 1198+63 | 327.93 MB | 31 Mar 2012 - 23:04 |
Unknown robot (identified by 'spider') | 1246+12 | 395.38 MB | 31 Mar 2012 - 19:15 |
BaiDuSpider | 967+71 | 66.44 MB | 31 Mar 2012 - 21:36 |
Unknown robot (identified by hit on 'robots.txt') | 0+868 | 28.33 KB | 31 Mar 2012 - 23:01 |
Sogou Spider | 660+11 | 209.59 MB | 31 Mar 2012 - 19:56 |
Nutch | 360+104 | 92.91 MB | 31 Mar 2012 - 05:51 |
Unknown robot (identified by 'robot') | 310+38 | 274.78 MB | 31 Mar 2012 - 18:15 |
Feedfetcher-Google | 278 | 1.83 MB | 31 Mar 2012 - 22:31 |
Unknown robot (identified by '*bot') | 84+110 | 1.29 MB | 31 Mar 2012 - 22:47 |
Speedy Spider | 128+57 | 34.40 MB | 31 Mar 2012 - 04:51 |
Unknown robot (identified by 'discovery') | 154+29 | 284.47 MB | 31 Mar 2012 - 09:18 |
archive.org bot | 161+19 | 100.84 MB | 31 Mar 2012 - 00:17 |
MJ12bot | 109+24 | 7.85 MB | 30 Mar 2012 - 20:59 |
Yahoo Slurp | 98+26 | 26.25 MB | 30 Mar 2012 - 21:26 |
Java (Often spam bot) | 103+1 | 10.22 MB | 29 Mar 2012 - 16:36 |
Jakarta commons-httpclient | 88 | 20.53 MB | 31 Mar 2012 - 09:51 |
MagpieRSS | 70+17 | 499.17 KB | 30 Mar 2012 - 22:38 |
yacy | 59+5 | 15.43 MB | 30 Mar 2012 - 16:08 |
Harvest | 56 | 171.28 KB | 30 Mar 2012 - 16:18 |
MSNBot-media | 35+18 | 1.49 MB | 31 Mar 2012 - 01:04 |
WordPress | 43 | 21.23 MB | 28 Mar 2012 - 09:46 |
Exabot | 30+12 | 500.00 KB | 22 Mar 2012 - 00:56 |
LinkBot | 35+2 | 5.65 MB | 19 Mar 2012 - 18:13 |
OutfoxBot/YodaoBot | 34 | 242.18 KB | 31 Mar 2012 - 14:54 |
FaceBook bot | 29 | 1.57 MB | 28 Mar 2012 - 23:28 |
WGet tools | 24+2 | 27.79 MB | 22 Mar 2012 - 23:56 |
DoCoMo | 13+12 | 306.23 KB | 31 Mar 2012 - 01:01 |
bender focused_crawler | 11+8 | 46.47 MB | 31 Mar 2012 - 06:32 |
Alexa (IA Archiver) | 1+18 | 13.97 KB | 31 Mar 2012 - 01:17 |
CFNetwork | 18 | 4.17 MB | 27 Mar 2012 - 08:10 |
Mail.ru bot | 14+2 | 9.50 MB | 31 Mar 2012 - 02:33 |
GigaBot | 8+8 | 57.27 KB | 27 Mar 2012 - 01:36 |
legs | 7+7 | 8.50 MB | 31 Mar 2012 - 14:45 |
MSNBot | 9+2 | 2.11 MB | 31 Mar 2012 - 22:32 |
Findlinks | 7+4 | 261.44 KB | 29 Mar 2012 - 05:55 |
Turn It In | 6+4 | 8.05 MB | 29 Mar 2012 - 23:21 |
ichiro | 8+2 | 103.92 KB | 28 Mar 2012 - 21:01 |
SeznamBot | 3+5 | 2.43 MB | 21 Mar 2012 - 12:44 |
Perl tool | 7 | 72.33 KB | 27 Mar 2012 - 10:13 |
Powermarks | 5 | 28.38 KB | 24 Mar 2012 - 02:10 |
Motor | 5 | 435.64 KB | 29 Mar 2012 - 13:17 |
HTTrack off-line browser | 4 | 5.60 MB | 21 Mar 2012 - 05:04 |
NG 1.x (Exalead) | 3 | 487.24 KB | 20 Mar 2012 - 22:26 |
Seekbot | 1+1 | 37.48 KB | 20 Mar 2012 - 22:01 |
W3C Link Checker | 1+1 | 31 Bytes | 15 Mar 2012 - 06:52 |
Voila | 0+1 | 31 Bytes | 15 Mar 2012 - 04:02 |
larbin | 0+1 | 31 Bytes | 07 Mar 2012 - 22:34 |
Araneo | 0+1 | 31 Bytes | 31 Mar 2012 - 07:41 |
MSIECrawler | 0+1 | 31 Bytes | 26 Mar 2012 - 01:21 |
Netcraft | 1 | 0 | 31 Mar 2012 - 20:20 |
Others | 0 | 0 | |