|
Last change
on this file since 30991 was 30991, checked in by davidb, 7 years ago |
|
Inital cut at README notes, and supporting links
|
|
File size:
1.3 KB
|
| Line | |
|---|
| 1 | ----
|
|---|
| 2 | Introduction
|
|---|
| 3 | ----
|
|---|
| 4 |
|
|---|
| 5 | Vargrant provisioning files to spin up a modest Solr cluster/cloud
|
|---|
| 6 | (zookeeper + 3 solr nodes) for experiments in ingesting HTRC Extracted
|
|---|
| 7 | Feature JSON files, which in turn has been processed by a Hadoop cluster.
|
|---|
| 8 |
|
|---|
| 9 |
|
|---|
| 10 | *Assumptions*
|
|---|
| 11 |
|
|---|
| 12 | * You have VirtualBox and Vagrant installed
|
|---|
| 13 | (at time of writing VirtualBox v5.0.28, Vagrant 1.8.6)
|
|---|
| 14 |
|
|---|
| 15 |
|
|---|
| 16 | *Useful*
|
|---|
| 17 |
|
|---|
| 18 | * Installing the Vagrant VirutalBox Guest Additions plugin to stop warnings
|
|---|
| 19 | about potentially incompatible versions:
|
|---|
| 20 |
|
|---|
| 21 | vagrant plugin install vagrant-vbguest
|
|---|
| 22 |
|
|---|
| 23 |
|
|---|
| 24 | ----
|
|---|
| 25 | Setup Procedure
|
|---|
| 26 | ----
|
|---|
| 27 |
|
|---|
| 28 | 1. Spin up cloud:
|
|---|
| 29 |
|
|---|
| 30 | vagrant up
|
|---|
| 31 |
|
|---|
| 32 | If this is the first time run, then this can take a while to run.
|
|---|
| 33 |
|
|---|
| 34 |
|
|---|
| 35 | 2. Log into 'zookeeper' and change to the 'htrc' user:
|
|---|
| 36 |
|
|---|
| 37 | vagrant ssh zookeeper
|
|---|
| 38 | sudo su - htrc
|
|---|
| 39 |
|
|---|
| 40 | 3. Use the 'start-solr-all.sh' script on 'zookeeper' to launch Solr daemons
|
|---|
| 41 | processes on each solr node in the cluster/cloud.
|
|---|
| 42 |
|
|---|
| 43 | solr-start-all.sh
|
|---|
| 44 |
|
|---|
| 45 | This runs a (password authenticated) ssh command on each node to start
|
|---|
| 46 | its solr instance.
|
|---|
| 47 |
|
|---|
| 48 | 4. If the first time the solr cloud has been spun up then create a solr
|
|---|
| 49 | collection for the htrc extracted features to be ingested into (htrc-pd-ef)
|
|---|
| 50 |
|
|---|
| 51 | ssh solr1 init-solr-collection.sh
|
|---|
| 52 |
|
|---|
| 53 | It doesn't matter which solr node is used to create the collection 'solr1'
|
|---|
| 54 | chosen for convenience.
|
|---|
| 55 |
|
|---|
| 56 |
|
|---|
| 57 |
|
|---|
Note:
See
TracBrowser
for help on using the repository browser.
