Last change
on this file since 30991 was 30991, checked in by davidb, 7 years ago |
Inital cut at README notes, and supporting links
|
File size:
1.3 KB
|
Rev | Line | |
---|
[30991] | 1 | ----
|
---|
| 2 | Introduction
|
---|
| 3 | ----
|
---|
[30956] | 4 |
|
---|
[30991] | 5 | Vargrant provisioning files to spin up a modest Solr cluster/cloud
|
---|
| 6 | (zookeeper + 3 solr nodes) for experiments in ingesting HTRC Extracted
|
---|
| 7 | Feature JSON files, which in turn has been processed by a Hadoop cluster.
|
---|
[30956] | 8 |
|
---|
| 9 |
|
---|
[30991] | 10 | *Assumptions*
|
---|
| 11 |
|
---|
| 12 | * You have VirtualBox and Vagrant installed
|
---|
| 13 | (at time of writing VirtualBox v5.0.28, Vagrant 1.8.6)
|
---|
| 14 |
|
---|
| 15 |
|
---|
| 16 | *Useful*
|
---|
| 17 |
|
---|
| 18 | * Installing the Vagrant VirutalBox Guest Additions plugin to stop warnings
|
---|
| 19 | about potentially incompatible versions:
|
---|
| 20 |
|
---|
| 21 | vagrant plugin install vagrant-vbguest
|
---|
| 22 |
|
---|
| 23 |
|
---|
| 24 | ----
|
---|
| 25 | Setup Procedure
|
---|
| 26 | ----
|
---|
| 27 |
|
---|
| 28 | 1. Spin up cloud:
|
---|
| 29 |
|
---|
| 30 | vagrant up
|
---|
| 31 |
|
---|
| 32 | If this is the first time run, then this can take a while to run.
|
---|
| 33 |
|
---|
| 34 |
|
---|
| 35 | 2. Log into 'zookeeper' and change to the 'htrc' user:
|
---|
| 36 |
|
---|
| 37 | vagrant ssh zookeeper
|
---|
| 38 | sudo su - htrc
|
---|
| 39 |
|
---|
| 40 | 3. Use the 'start-solr-all.sh' script on 'zookeeper' to launch Solr daemons
|
---|
| 41 | processes on each solr node in the cluster/cloud.
|
---|
| 42 |
|
---|
| 43 | solr-start-all.sh
|
---|
| 44 |
|
---|
| 45 | This runs a (password authenticated) ssh command on each node to start
|
---|
| 46 | its solr instance.
|
---|
| 47 |
|
---|
| 48 | 4. If the first time the solr cloud has been spun up then create a solr
|
---|
| 49 | collection for the htrc extracted features to be ingested into (htrc-pd-ef)
|
---|
| 50 |
|
---|
| 51 | ssh solr1 init-solr-collection.sh
|
---|
| 52 |
|
---|
| 53 | It doesn't matter which solr node is used to create the collection 'solr1'
|
---|
| 54 | chosen for convenience.
|
---|
| 55 |
|
---|
| 56 |
|
---|
| 57 |
|
---|
Note:
See
TracBrowser
for help on using the repository browser.