| 1 | =======================================
|
|---|
| 2 | | Eurovision -- Let it Sparkle/Sparql |
|
|---|
| 3 | =======================================
|
|---|
| 4 | | Preparing and Building ESC content |
|
|---|
| 5 | ---------------------------------------
|
|---|
| 6 |
|
|---|
| 7 | --
|
|---|
| 8 | 1. Follow Steps 1-4 in BUILDING-FROM-IMPORT.txt
|
|---|
| 9 | --
|
|---|
| 10 |
|
|---|
| 11 | You do not need to do the last step which involves using 'wget' to
|
|---|
| 12 | download import.tar.gz, unpack it, and then fully build the
|
|---|
| 13 | collection.
|
|---|
| 14 |
|
|---|
| 15 | Following these instructions you will populate the import
|
|---|
| 16 | directory directly through running the prepare scripts.
|
|---|
| 17 |
|
|---|
| 18 | --
|
|---|
| 19 | 2. Take a look at the PREPARE.sh script
|
|---|
| 20 | --
|
|---|
| 21 |
|
|---|
| 22 | If not already done so, ensure you have source Greenstone3's
|
|---|
| 23 | gs3-setup.sh and changed to the 'eurovision' collection's directory
|
|---|
| 24 |
|
|---|
| 25 | cd <greenstone3-src-home>
|
|---|
| 26 | source ./gs3-setup.sh
|
|---|
| 27 | cd web/sites/eurovision-lod/collect/eurovision
|
|---|
| 28 |
|
|---|
| 29 | Now take a look at the PREPARE.sh script:
|
|---|
| 30 |
|
|---|
| 31 | cat PREPARE.sh
|
|---|
| 32 |
|
|---|
| 33 | This is a convenience script that strings together a set of of scripts in
|
|---|
| 34 | the 'prepare' directory for downloading and unzipping primary soure data,
|
|---|
| 35 | which is then processed and turned into a format the Greenstone can use.
|
|---|
| 36 |
|
|---|
| 37 | Each script can be run on its own from the command-line, just make sure
|
|---|
| 38 | you are in the 'prepare' folder when you run them. The names of the
|
|---|
| 39 | scripts seek to be informative over what operation they do. For the
|
|---|
| 40 | most part they come in pairs: the first generates the data within
|
|---|
| 41 | the 'prepare' area, and then the second script transforms and copies
|
|---|
| 42 | it into the 'import' directory.
|
|---|
| 43 |
|
|---|
| 44 |
|
|---|
| 45 | ./01-DOWNLOAD-ESC-LOD-DATA.sh
|
|---|
| 46 | ./02-EXPLODE-SPARQLRESULTS-TO-IMPORT.sh
|
|---|
| 47 |
|
|---|
| 48 | ./03-GEN-VOTING-METADATA.sh
|
|---|
| 49 | ./04-COPY-VOTING-METADATA-TO-IMPORT.sh
|
|---|
| 50 |
|
|---|
| 51 | ./05-PARSE-ADDITIONAL-METADATA-FROM-WIKIPEDIA.sh
|
|---|
| 52 | ./06-COPY-PARSED-ADDITIONAL-METADATA-TO-IMPORT.sh
|
|---|
| 53 |
|
|---|
| 54 | ./07-DOWNLOAD-SPOTIFY-LOD-DATA.sh
|
|---|
| 55 | ./08-EXPLODE-SPOTIFY-SPARQLRESULTS-TO-IMPORT.sh
|
|---|
| 56 |
|
|---|
| 57 | ./09-GEN-PROBLEM-LOD-LISTS.sh
|
|---|
| 58 |
|
|---|
| 59 |
|
|---|
| 60 |
|
|---|
| 61 |
|
|---|
| 62 | --
|
|---|
| 63 | 4. Run PREPARE.sh followed by FULL-REBUILD.sh
|
|---|
| 64 | --
|
|---|
| 65 |
|
|---|
| 66 |
|
|---|
| 67 | export FULL_GREENSTONE_URL_PREFIX=http://mydomain.org/greenstone3/library
|
|---|
| 68 |
|
|---|
| 69 | cd prepare && ./PREPARE.sh && cd ..
|
|---|
| 70 |
|
|---|
| 71 | ./FULL-REBUILD.sh
|
|---|
| 72 |
|
|---|
