53 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 1076596+2538 | 16.55 GB | 31 Aug 2011 - 23:59 |
Yahoo Slurp | 47139+71 | 15.60 GB | 31 Aug 2011 - 23:58 |
Googlebot | 45615+40 | 24.04 GB | 31 Aug 2011 - 23:57 |
Unknown robot (identified by 'robot') | 9296+26 | 214.41 MB | 31 Aug 2011 - 14:40 |
Unknown robot (identified by 'bot*') | 7611+722 | 2.19 GB | 31 Aug 2011 - 23:10 |
Yandex bot | 4124+39 | 2.34 GB | 31 Aug 2011 - 23:54 |
Unknown robot (identified by 'spider') | 1159+7 | 16.06 MB | 31 Aug 2011 - 21:49 |
Unknown robot (identified by hit on 'robots.txt') | 0+919 | 27.82 KB | 31 Aug 2011 - 21:22 |
Unknown robot (identified by empty user agent string) | 815+20 | 914.35 MB | 31 Aug 2011 - 21:58 |
Heritrix | 735+8 | 8.36 MB | 29 Aug 2011 - 17:50 |
BaiDuSpider | 547+9 | 142.16 MB | 31 Aug 2011 - 23:53 |
bender focused_crawler | 421+13 | 809.87 MB | 31 Aug 2011 - 09:45 |
Custo | 386+47 | 187.39 MB | 31 Aug 2011 - 21:11 |
Unknown robot (identified by 'discovery') | 290+123 | 1.30 GB | 31 Aug 2011 - 18:34 |
Nutch | 213+34 | 30.47 MB | 31 Aug 2011 - 19:07 |
Java (Often spam bot) | 244+2 | 7.33 MB | 31 Aug 2011 - 18:10 |
Speedy Spider | 142+101 | 50.50 MB | 30 Aug 2011 - 16:38 |
Feedfetcher-Google | 237 | 6.85 MB | 31 Aug 2011 - 23:36 |
Unknown robot (identified by '*bot') | 96+82 | 8.23 MB | 31 Aug 2011 - 20:30 |
WordPress | 119 | 28.49 MB | 31 Aug 2011 - 13:23 |
psbot | 110+6 | 1.90 MB | 23 Aug 2011 - 14:48 |
Sogou Spider | 90+4 | 167.17 MB | 31 Aug 2011 - 21:40 |
archive.org bot | 74+8 | 43.33 MB | 24 Aug 2011 - 18:25 |
Exabot | 46+18 | 621.71 KB | 31 Aug 2011 - 08:24 |
OutfoxBot/YodaoBot | 62 | 441.63 KB | 25 Aug 2011 - 06:27 |
Jakarta commons-httpclient | 54 | 3.70 MB | 31 Aug 2011 - 15:57 |
Harvest | 53 | 172.29 KB | 30 Aug 2011 - 16:36 |
MSNBot-media | 34+16 | 1.50 MB | 30 Aug 2011 - 06:40 |
Motor | 38 | 13.19 MB | 25 Aug 2011 - 19:52 |
CFNetwork | 35 | 34.13 MB | 23 Aug 2011 - 17:00 |
MJ12bot | 15+19 | 237.07 KB | 30 Aug 2011 - 19:40 |
legs | 6+24 | 4.88 MB | 31 Aug 2011 - 20:13 |
FaceBook bot | 29 | 596.35 KB | 27 Aug 2011 - 19:11 |
Findlinks | 10+11 | 373.98 KB | 31 Aug 2011 - 15:24 |
Alexa (IA Archiver) | 0+15 | 465 Bytes | 30 Aug 2011 - 05:45 |
Perl tool | 15 | 33.53 MB | 31 Aug 2011 - 19:50 |
WGet tools | 7+3 | 763.37 KB | 25 Aug 2011 - 16:43 |
MSIECrawler | 5+5 | 34.23 KB | 12 Aug 2011 - 06:46 |
DoCoMo | 7+2 | 129.59 KB | 28 Aug 2011 - 02:56 |
Python-urllib | 9 | 1.37 MB | 30 Aug 2011 - 16:04 |
Powermarks | 6 | 1.36 MB | 30 Aug 2011 - 10:30 |
BSpider | 1+3 | 1.21 MB | 03 Aug 2011 - 20:28 |
W3C Link Checker | 2+2 | 62 Bytes | 21 Aug 2011 - 23:58 |
BBot | 4 | 2.62 MB | 15 Aug 2011 - 16:51 |
MojeekBot | 1+1 | 37.48 KB | 29 Aug 2011 - 02:05 |
GigaBot | 1+1 | 37.48 KB | 30 Aug 2011 - 06:16 |
HTTrack off-line browser | 2 | 2.43 MB | 19 Aug 2011 - 11:31 |
FavIconizer | 2 | 14.25 KB | 23 Aug 2011 - 17:03 |
larbin | 1+1 | 7.15 KB | 17 Aug 2011 - 20:04 |
VORTEX | 2 | 93.11 KB | 08 Aug 2011 - 16:38 |
Netcraft | 2 | 7.12 KB | 25 Aug 2011 - 00:14 |
gammaSpider, FocusedCrawler | 1 | 36.58 KB | 30 Aug 2011 - 14:48 |
Voyager | 1 | 1.21 MB | 09 Aug 2011 - 02:26 |
Others | 0 | 0 | |