|
Last change
on this file since 31019 was 31009, checked in by davidb, 7 years ago |
|
Adjustments after latest fresh 'vagrant up' trial
|
|
File size:
1.4 KB
|
| Line | |
|---|
| 1 | ----
|
|---|
| 2 | Introduction
|
|---|
| 3 | ----
|
|---|
| 4 |
|
|---|
| 5 | Vargrant provisioning files to spin up a modest Solr cluster/cloud
|
|---|
| 6 | (zookeeper + 3 solr nodes) for experiments in ingesting HTRC Extracted
|
|---|
| 7 | Feature JSON files, which in turn has been processed by a Hadoop cluster.
|
|---|
| 8 |
|
|---|
| 9 |
|
|---|
| 10 | *Assumptions*
|
|---|
| 11 |
|
|---|
| 12 | * You have VirtualBox and Vagrant installed
|
|---|
| 13 | (at time of writing VirtualBox v5.0.28, Vagrant 1.8.6)
|
|---|
| 14 |
|
|---|
| 15 |
|
|---|
| 16 | *Useful*
|
|---|
| 17 |
|
|---|
| 18 | * Installing the Vagrant VirutalBox Guest Additions plugin to stop warnings
|
|---|
| 19 | about potentially incompatible versions:
|
|---|
| 20 |
|
|---|
| 21 | vagrant plugin install vagrant-vbguest
|
|---|
| 22 |
|
|---|
| 23 |
|
|---|
| 24 | ----
|
|---|
| 25 | Setup Procedure
|
|---|
| 26 | ----
|
|---|
| 27 |
|
|---|
| 28 |
|
|---|
| 29 | 1. Spin up cloud:
|
|---|
| 30 |
|
|---|
| 31 | vagrant up
|
|---|
| 32 |
|
|---|
| 33 | If this is the first time run, then this can take a while to run.
|
|---|
| 34 |
|
|---|
| 35 |
|
|---|
| 36 | 2. Log into 'zookeeper' and change to the 'htrc' user:
|
|---|
| 37 |
|
|---|
| 38 | vagrant ssh zookeeper
|
|---|
| 39 | sudo su - htrc
|
|---|
| 40 |
|
|---|
| 41 | 3. Start the zookeeper daemon:
|
|---|
| 42 | zookeeper-start.sh
|
|---|
| 43 |
|
|---|
| 44 | 4. Use the 'start-solr-all.sh' script on 'zookeeper' to launch Solr daemons
|
|---|
| 45 | processes on each solr node in the cluster/cloud.
|
|---|
| 46 |
|
|---|
| 47 | ./solr-start-all.sh
|
|---|
| 48 |
|
|---|
| 49 | This runs a (password authenticated) ssh command on each node to start
|
|---|
| 50 | its solr instance.
|
|---|
| 51 |
|
|---|
| 52 | 5. If the first time the solr cloud has been spun up then create a solr
|
|---|
| 53 | collection for the htrc extracted features to be ingested into (htrc-pd-ef)
|
|---|
| 54 |
|
|---|
| 55 | ssh solr1 ./solr-init-collection.sh
|
|---|
| 56 |
|
|---|
| 57 | It doesn't matter which solr node is used to create the collection 'solr1'
|
|---|
| 58 | chosen for convenience.
|
|---|
| 59 |
|
|---|
| 60 | Now view the information in the Solr cloud through:
|
|---|
| 61 |
|
|---|
| 62 | http://10.11.0.53:8983/solr
|
|---|
| 63 |
|
|---|
Note:
See
TracBrowser
for help on using the repository browser.
