54 different robots | Hits | Bandwidth | Last visit |
Googlebot | 54538+727 | 27.23 GB | 31 Mar 2013 - 23:57 |
BaiDuSpider | 3007 | 46.09 MB | 31 Mar 2013 - 23:55 |
Unknown robot (identified by 'bot*') | 35152+168 | 4.90 GB | 31 Mar 2013 - 23:54 |
Feedfetcher-Google | 1225 | 21.91 MB | 31 Mar 2013 - 23:54 |
MagpieRSS | 151+20 | 1.24 MB | 31 Mar 2013 - 23:44 |
Yandex bot | 8630+114 | 3.29 GB | 31 Mar 2013 - 23:43 |
WordPress | 482 | 72.88 MB | 31 Mar 2013 - 23:28 |
Exabot | 204+42 | 40.25 MB | 31 Mar 2013 - 23:16 |
Yahoo Slurp | 691+76 | 21.79 MB | 31 Mar 2013 - 22:57 |
Unknown robot (identified by hit on 'robots.txt') | 0+602 | 52.32 KB | 31 Mar 2013 - 22:43 |
Unknown robot (identified by 'spider') | 4181+3 | 1.01 GB | 31 Mar 2013 - 22:22 |
BSpider | 206+24 | 8.13 MB | 31 Mar 2013 - 21:54 |
Python-urllib | 38+6 | 13.29 MB | 31 Mar 2013 - 20:20 |
Unknown robot (identified by 'robot') | 67+21 | 37.19 MB | 31 Mar 2013 - 19:17 |
Unknown robot (identified by empty user agent string) | 263+29 | 105.73 MB | 31 Mar 2013 - 19:17 |
larbin | 3+3 | 3.92 MB | 31 Mar 2013 - 18:41 |
Unknown robot (identified by 'crawl') | 2904+85 | 662.89 MB | 31 Mar 2013 - 11:48 |
Jakarta commons-httpclient | 85 | 7.38 MB | 31 Mar 2013 - 10:05 |
MSNBot | 568+43 | 30.82 MB | 31 Mar 2013 - 08:20 |
FaceBook bot | 92+1 | 11.90 MB | 31 Mar 2013 - 08:12 |
Alexa (IA Archiver) | 2+13 | 55.45 KB | 31 Mar 2013 - 05:56 |
Combine System | 1+3 | 46.63 KB | 31 Mar 2013 - 04:38 |
Java (Often spam bot) | 98+6 | 33.73 MB | 31 Mar 2013 - 03:10 |
Harvest | 180 | 6.96 MB | 31 Mar 2013 - 02:32 |
CFNetwork | 35 | 9.83 MB | 31 Mar 2013 - 01:24 |
NG 1.x (Exalead) | 41 | 0 | 30 Mar 2013 - 20:42 |
Nutch | 521+42 | 33.64 MB | 30 Mar 2013 - 19:42 |
MSNBot-media | 20+43 | 7.11 MB | 30 Mar 2013 - 11:26 |
WGet tools | 70 | 81.97 MB | 30 Mar 2013 - 10:57 |
psbot | 1066+86 | 16.64 MB | 30 Mar 2013 - 08:32 |
Sogou Spider | 196+31 | 69.92 MB | 30 Mar 2013 - 07:55 |
MJ12bot | 12+13 | 358.91 KB | 29 Mar 2013 - 20:55 |
SeznamBot | 13+11 | 13.62 MB | 29 Mar 2013 - 20:55 |
Unknown robot (identified by '*bot') | 40+54 | 1.07 MB | 29 Mar 2013 - 16:05 |
DoCoMo | 560+14 | 19.14 MB | 29 Mar 2013 - 13:58 |
Perl tool | 10 | 371.21 KB | 29 Mar 2013 - 02:26 |
WebCollage | 1 | 79.89 KB | 28 Mar 2013 - 09:24 |
yacy | 46+11 | 10.90 MB | 27 Mar 2013 - 13:10 |
HTTrack off-line browser | 2 | 2.43 MB | 26 Mar 2013 - 14:00 |
Steeler | 5+10 | 9.24 KB | 25 Mar 2013 - 20:39 |
legs | 2+6 | 17.27 KB | 25 Mar 2013 - 19:50 |
Custo | 0+1 | 89 Bytes | 25 Mar 2013 - 10:41 |
FavIconizer | 4 | 33.50 KB | 20 Mar 2013 - 11:20 |
OutfoxBot/YodaoBot | 18 | 150.75 KB | 20 Mar 2013 - 05:49 |
Phantom | 4 | 4.75 MB | 19 Mar 2013 - 08:49 |
Mail.ru bot | 239+6 | 145.96 MB | 18 Mar 2013 - 22:06 |
Heritrix | 4+1 | 13.23 MB | 17 Mar 2013 - 05:24 |
Web Core / Roots | 2 | 11.76 MB | 16 Mar 2013 - 07:03 |
MSIECrawler | 0+1 | 89 Bytes | 14 Mar 2013 - 02:55 |
WebFilter | 5+2 | 151.02 KB | 09 Mar 2013 - 20:52 |
Netcraft | 2 | 8.38 KB | 08 Mar 2013 - 18:52 |
archive.org bot | 1+2 | 1.21 MB | 08 Mar 2013 - 03:43 |
Unknown robot (identified by 'discovery') | 1+1 | 8.46 KB | 07 Mar 2013 - 08:51 |
Raven Search | 5 | 1.21 MB | 03 Mar 2013 - 18:48 |