54 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 333772+494 | 4.94 GB | 31 Jan 2011 - 23:59 |
Yahoo Slurp | 18495+92 | 15.85 GB | 31 Jan 2011 - 23:59 |
Googlebot | 13152+31 | 16.69 GB | 31 Jan 2011 - 23:52 |
Unknown robot (identified by 'bot*') | 8249+1263 | 4.79 GB | 31 Jan 2011 - 23:48 |
Unknown robot (identified by 'discovery') | 8529+47 | 12.49 GB | 31 Jan 2011 - 23:57 |
Yandex bot | 7535+34 | 3.11 GB | 31 Jan 2011 - 03:44 |
Python-urllib | 6914 | 2.02 GB | 31 Jan 2011 - 09:57 |
Unknown robot (identified by empty user agent string) | 807+29 | 893.16 MB | 31 Jan 2011 - 23:54 |
MSNBot-media | 415+135 | 19.21 MB | 31 Jan 2011 - 14:59 |
BaiDuSpider | 482+64 | 112.87 MB | 31 Jan 2011 - 22:09 |
Unknown robot (identified by 'robot') | 302+25 | 38.03 MB | 31 Jan 2011 - 09:26 |
Custo | 257+47 | 132.77 MB | 30 Jan 2011 - 21:07 |
Speedy Spider | 123+105 | 12.66 MB | 31 Jan 2011 - 22:43 |
Unknown robot (identified by hit on 'robots.txt') | 0+160 | 4.84 KB | 31 Jan 2011 - 22:27 |
Java (Often spam bot) | 151+2 | 40.82 MB | 30 Jan 2011 - 20:27 |
bender focused_crawler | 106+37 | 135.99 MB | 29 Jan 2011 - 12:21 |
Exabot | 104+16 | 3.26 MB | 31 Jan 2011 - 00:38 |
WGet tools | 86+1 | 7.51 MB | 22 Jan 2011 - 07:43 |
Alexa (IA Archiver) | 1+79 | 13.27 KB | 31 Jan 2011 - 05:40 |
Unknown robot (identified by 'spider') | 41+27 | 8.13 MB | 31 Jan 2011 - 01:26 |
Spiderman | 67+1 | 1.93 MB | 18 Jan 2011 - 00:42 |
Feedfetcher-Google | 65 | 178.51 KB | 31 Jan 2011 - 22:35 |
WordPress | 61 | 2.09 MB | 26 Jan 2011 - 03:52 |
Sogou Spider | 50+4 | 19.23 MB | 30 Jan 2011 - 18:18 |
Jakarta commons-httpclient | 47 | 8.57 MB | 31 Jan 2011 - 21:01 |
Harvest | 45 | 174.83 KB | 31 Jan 2011 - 00:47 |
Nutch | 18+18 | 3.93 MB | 31 Jan 2011 - 16:37 |
legs | 24+5 | 1.92 MB | 29 Jan 2011 - 09:29 |
MSIECrawler | 7+16 | 7.29 MB | 31 Jan 2011 - 07:20 |
Motor | 15 | 12.95 MB | 26 Jan 2011 - 23:36 |
Perl tool | 14 | 1.27 MB | 26 Jan 2011 - 20:23 |
FaceBook bot | 13 | 113.94 KB | 31 Jan 2011 - 18:59 |
The web archive (IA Archiver) | 0+12 | 372 Bytes | 25 Jan 2011 - 18:50 |
GigaBot | 3+6 | 305.87 KB | 28 Jan 2011 - 09:38 |
Ask | 5+4 | 145.86 KB | 25 Jan 2011 - 14:01 |
Bloglines | 8 | 34.03 KB | 19 Jan 2011 - 12:23 |
Unknown robot (identified by '*bot') | 8 | 3.01 MB | 27 Jan 2011 - 13:47 |
NG 1.x (Exalead) | 7 | 4.51 MB | 26 Jan 2011 - 19:04 |
yacy | 6+1 | 360.94 KB | 31 Jan 2011 - 12:37 |
HTTrack off-line browser | 5 | 5.37 MB | 30 Jan 2011 - 14:54 |
Findlinks | 2+2 | 74.96 KB | 28 Jan 2011 - 22:05 |
Voyager | 4 | 149.80 KB | 26 Jan 2011 - 18:30 |
T-H-U-N-D-E-R-S-T-O-N-E | 2+1 | 93.92 KB | 12 Jan 2011 - 02:42 |
Voila | 0+3 | 93 Bytes | 18 Jan 2011 - 20:04 |
MSNBot | 2 | 14.03 KB | 01 Jan 2011 - 00:01 |
OutfoxBot/YodaoBot | 1+1 | 720 Bytes | 13 Jan 2011 - 04:21 |
CFNetwork | 2 | 1.71 MB | 29 Jan 2011 - 21:30 |
BBot | 2 | 2.09 MB | 30 Jan 2011 - 10:59 |
Unknown robot (identified by 'checker') | 1+1 | 1.21 MB | 30 Jan 2011 - 10:10 |
Powermarks | 1 | 37.45 KB | 14 Jan 2011 - 08:40 |
BSpider | 1 | 100.30 KB | 26 Jan 2011 - 15:58 |
FavIconizer | 1 | 7.02 KB | 28 Jan 2011 - 18:00 |
archive.org bot | 0+1 | 31 Bytes | 14 Jan 2011 - 14:17 |
Netcraft | 1 | 7.02 KB | 25 Jan 2011 - 20:48 |