Last change
on this file since 30903 was 30903, checked in by davidb, 7 years ago |
Vagrant provisioning files for a 4-node Hadoop cluster. See README.txt for more details
|
File size:
539 bytes
|
Line | |
---|
1 |
|
---|
2 | Vargrant provisioning files to spin up a modest (4 node) Hadoop
|
---|
3 | cluster for experiments processing HTRC Extracted Feature JSON files
|
---|
4 | suitable for ingesting into Solr.
|
---|
5 |
|
---|
6 | Top-level code Apache Spark, processing HDFS stored JSON files, hence
|
---|
7 | the need for an underlying Hadoop cluster.
|
---|
8 |
|
---|
9 | Provisioning based on the following online resources, but updated to
|
---|
10 | use newer versions of Ubuntu, Java, and Hadoop.
|
---|
11 |
|
---|
12 | http://cscarioni.blogspot.co.nz/2012/09/setting-up-hadoop-virtual-cluster-with.html
|
---|
13 |
|
---|
14 | https://github.com/calo81/vagrant-hadoop-cluster
|
---|
Note:
See
TracBrowser
for help on using the repository browser.