52 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 37882+312 | 517.52 MB | 31 Oct 2014 - 23:59 |
BaiDuSpider | 10981+12 | 1.83 GB | 31 Oct 2014 - 23:59 |
Googlebot | 33721+730 | 23.15 GB | 31 Oct 2014 - 23:58 |
Yahoo Slurp | 17502+53 | 2.24 GB | 31 Oct 2014 - 23:57 |
Yandex bot | 6334+92 | 6.15 GB | 31 Oct 2014 - 23:56 |
Unknown robot (identified by 'bot*') | 45528+1608 | 8.49 GB | 31 Oct 2014 - 23:53 |
archive.org bot | 53+22 | 14.56 MB | 31 Oct 2014 - 23:18 |
Unknown robot (identified by hit on 'robots.txt') | 0+496 | 43.11 KB | 31 Oct 2014 - 22:55 |
Feedfetcher-Google | 472 | 12.05 MB | 31 Oct 2014 - 22:25 |
Java (Often spam bot) | 184+4 | 3.84 MB | 31 Oct 2014 - 21:39 |
MagpieRSS | 120+39 | 1008.86 KB | 31 Oct 2014 - 20:44 |
Unknown robot (identified by 'robot') | 206+37 | 179.25 MB | 31 Oct 2014 - 20:42 |
Unknown robot (identified by empty user agent string) | 1025+18 | 999.76 MB | 31 Oct 2014 - 20:01 |
FavIconizer | 57 | 8.88 MB | 31 Oct 2014 - 19:40 |
Harvest | 48 | 137.99 KB | 31 Oct 2014 - 17:50 |
Exabot | 70+28 | 2.78 MB | 31 Oct 2014 - 17:39 |
Raven Search | 5 | 0 | 31 Oct 2014 - 16:12 |
MJ12bot | 56+36 | 2.11 MB | 31 Oct 2014 - 13:47 |
WGet tools | 14+1 | 44.63 MB | 31 Oct 2014 - 12:50 |
Jakarta commons-httpclient | 73+4 | 446.55 KB | 31 Oct 2014 - 11:43 |
Sogou Spider | 581+49 | 153.73 MB | 31 Oct 2014 - 10:18 |
LinkChecker | 33 | 4.20 MB | 31 Oct 2014 - 04:05 |
Perl tool | 14 | 2.78 MB | 31 Oct 2014 - 03:40 |
Unknown robot (identified by 'spider') | 86+12 | 13.09 MB | 31 Oct 2014 - 01:54 |
Phantom | 3 | 608.06 KB | 30 Oct 2014 - 21:37 |
Sift | 10 | 160.58 KB | 30 Oct 2014 - 21:36 |
WordPress | 321 | 87.29 MB | 30 Oct 2014 - 19:09 |
SpiderBot | 1+1 | 1.79 MB | 30 Oct 2014 - 17:48 |
Python-urllib | 329+6 | 89.42 MB | 30 Oct 2014 - 06:19 |
Nutch | 20+13 | 70.84 MB | 30 Oct 2014 - 05:03 |
CFNetwork | 17 | 2.02 MB | 30 Oct 2014 - 02:21 |
WebFilter | 18+16 | 312.69 KB | 30 Oct 2014 - 01:53 |
FaceBook bot | 795 | 67.00 MB | 29 Oct 2014 - 22:24 |
psbot | 715+25 | 11.07 MB | 29 Oct 2014 - 13:51 |
Alexa (IA Archiver) | 3+1 | 204.79 KB | 28 Oct 2014 - 17:27 |
MSNBot-media | 4+5 | 33.39 KB | 28 Oct 2014 - 14:49 |
HTTrack off-line browser | 27+2 | 10.30 MB | 26 Oct 2014 - 16:00 |
VSE | 0+2 | 178 Bytes | 25 Oct 2014 - 07:40 |
Patric | 4 | 1.92 MB | 23 Oct 2014 - 13:24 |
yacy | 50+11 | 19.18 MB | 22 Oct 2014 - 04:34 |
SeznamBot | 26+10 | 10.91 MB | 21 Oct 2014 - 12:27 |
Turn It In | 6+1 | 198.45 KB | 20 Oct 2014 - 16:18 |
larbin | 1+1 | 8.47 KB | 17 Oct 2014 - 05:25 |
MSNBot | 3 | 1.24 MB | 16 Oct 2014 - 14:39 |
Unknown robot (identified by 'checker') | 2 | 4.89 MB | 13 Oct 2014 - 21:23 |
Unknown robot (identified by '*bot') | 2+2 | 1.08 MB | 12 Oct 2014 - 16:38 |
HTMLParser | 2 | 467.61 KB | 12 Oct 2014 - 13:10 |
Web Core / Roots | 3+1 | 16.85 KB | 12 Oct 2014 - 07:30 |
NG 1.x (Exalead) | 1 | 0 | 09 Oct 2014 - 16:38 |
Netcraft | 2 | 8.38 KB | 08 Oct 2014 - 08:21 |
Heritrix | 109+3 | 240.59 MB | 07 Oct 2014 - 16:38 |
Mail.ru bot | 127+13 | 4.18 MB | 03 Oct 2014 - 16:08 |