52 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 68314+89 | 1.64 GB | 31 Jan 2016 - 21:58 |
Unknown robot (identified by 'bot*') | 39518+2522 | 15.64 GB | 31 Jan 2016 - 23:57 |
Yandex bot | 37267+133 | 28.98 GB | 31 Jan 2016 - 23:49 |
Yahoo Slurp | 31940+156 | 1.92 GB | 31 Jan 2016 - 23:59 |
Googlebot | 30248+822 | 21.79 GB | 31 Jan 2016 - 23:59 |
BaiDuSpider | 15142 | 2.16 GB | 31 Jan 2016 - 21:06 |
Custo | 6099 | 40.96 MB | 31 Jan 2016 - 21:29 |
Unknown robot (identified by empty user agent string) | 1964+20 | 1.06 GB | 31 Jan 2016 - 22:56 |
Sogou Spider | 794+57 | 324.79 MB | 31 Jan 2016 - 22:46 |
psbot | 813+21 | 12.76 MB | 31 Jan 2016 - 23:17 |
BetaBot | 580+24 | 11.61 MB | 27 Jan 2016 - 12:04 |
Python-urllib | 596+5 | 20.63 MB | 31 Jan 2016 - 09:18 |
Java (Often spam bot) | 543 | 52.75 MB | 31 Jan 2016 - 20:49 |
Unknown robot (identified by 'robot') | 79+184 | 33.88 MB | 31 Jan 2016 - 22:32 |
Unknown robot (identified by hit on 'robots.txt') | 0+245 | 21.29 KB | 31 Jan 2016 - 21:58 |
WordPress | 235 | 61.02 MB | 29 Jan 2016 - 06:46 |
FavIconizer | 208 | 20.87 MB | 31 Jan 2016 - 18:50 |
MagpieRSS | 152 | 1.27 MB | 31 Jan 2016 - 22:32 |
Exabot | 123+22 | 904.37 KB | 31 Jan 2016 - 12:52 |
yacy | 121+16 | 47.00 MB | 31 Jan 2016 - 10:04 |
Heritrix | 83+14 | 41.68 MB | 29 Jan 2016 - 11:37 |
MJ12bot | 93+4 | 9.50 MB | 29 Jan 2016 - 00:56 |
Harvest | 86 | 6.94 MB | 30 Jan 2016 - 22:58 |
Jakarta commons-httpclient | 70+1 | 6.36 MB | 31 Jan 2016 - 09:59 |
SeznamBot | 20+43 | 4.98 MB | 31 Jan 2016 - 15:50 |
HTTrack off-line browser | 61+1 | 84.90 MB | 31 Jan 2016 - 01:27 |
Phantom | 56 | 16.93 MB | 18 Jan 2016 - 15:28 |
Feedfetcher-Google | 46 | 2.89 MB | 31 Jan 2016 - 23:21 |
Unknown robot (identified by 'spider') | 34+11 | 1.27 MB | 31 Jan 2016 - 13:15 |
archive.org bot | 14+22 | 8.63 MB | 31 Jan 2016 - 13:40 |
FaceBook bot | 34 | 2.47 MB | 24 Jan 2016 - 08:53 |
LinkChecker | 32+1 | 4.20 MB | 31 Jan 2016 - 07:23 |
WGet tools | 25 | 44.50 MB | 31 Jan 2016 - 11:20 |
Nutch | 12+13 | 4.58 MB | 31 Jan 2016 - 20:43 |
CFNetwork | 16 | 17.00 MB | 26 Jan 2016 - 01:22 |
Sift | 12 | 193.26 KB | 31 Jan 2016 - 10:44 |
Perl tool | 12 | 968.91 KB | 31 Jan 2016 - 18:29 |
Alexa (IA Archiver) | 7+2 | 351.81 KB | 28 Jan 2016 - 14:10 |
Y!J Yahoo Japan | 6+2 | 54.31 KB | 14 Jan 2016 - 17:30 |
Feedburner | 5 | 0 | 08 Jan 2016 - 03:48 |
Unknown robot (identified by 'checker') | 5 | 0 | 29 Jan 2016 - 20:17 |
MSNBot | 3 | 32.25 KB | 23 Jan 2016 - 09:41 |
SpiderBot | 1+2 | 1.92 MB | 31 Jan 2016 - 11:09 |
W3C Link Checker | 1+1 | 89 Bytes | 07 Jan 2016 - 22:47 |
WebFilter | 1+1 | 64.23 KB | 28 Jan 2016 - 18:37 |
larbin | 1+1 | 46.45 KB | 26 Jan 2016 - 02:02 |
Netcraft | 2 | 8.56 KB | 11 Jan 2016 - 14:12 |
NG 1.x (Exalead) | 1 | 36.58 KB | 09 Jan 2016 - 03:43 |
MSNBot-media | 1 | 15.77 KB | 21 Jan 2016 - 18:37 |
Motor | 1 | 0 | 30 Jan 2016 - 11:10 |
StackRambler | 1 | 536.61 KB | 30 Jan 2016 - 14:47 |
NG 2.x (Exalead) | 0+1 | 89 Bytes | 22 Jan 2016 - 05:57 |