Changeset 35845


Ignore:
Timestamp:
2022-01-02T07:37:32+13:00 (2 years ago)
Author:
davidb
Message:

More details over what to do

File:
1 edited

Legend:

Unmodified
Added
Removed
  • main/trunk/model-sites-dev/eurovision-lod/collect/eurovision/prepare/README.txt

    r35844 r35845  
    3737
    3838
     39# Running the ALL-CAPS scripts
     40
     41The prefix to the scripts to run are sequentially numbers 01-...,
     4202-... and so on.
     43
     44The (personal) convention of using ALL-CAPS is to signify that these scripts
     45can be run without any arguments and they will do something meaningful, with
     46the caveat that the current working directory must be the directory where
     47the scripts are located.
     48
     49To aid development and testing, there is a 'small' set of files that
     50can be prepared, based on only the Eurovision entries for 2015.  The
     51sequence to run for that (at the time of writing) is:
     52
     53
     54    ./01-DOWNLOAD-ESC-LOD-DATA--SMALL.sh
     55   
     56    ./02-EXPLODE-SPARQLRESULTS-TO-IMPORT--SMALL.sh
     57   
     58    ./03-GEN-VOTING-METADATA.sh
     59   
     60    ./04-COPY-VOTING-METADATA-TO-IMPORT--SMALL.sh
     61   
     62    ./05-PARSE-ADDITIONAL-METADATA-FROM-WIKIPEDIA--SMALL.sh
     63   
     64    ./06-COPY-PARSED-ADDITIONAL-METADATA-TO-IMPORT.sh
     65   
     66    ./07a-DOWNLOAD-SPOTIFY-LOD-DATA--SMALL.sh
     67   
     68    ./08a-EXPLODE-SPOTIFY-SPARQLRESULTS-TO-IMPORT.sh
     69   
     70    ./09-GEN-PROBLEM-LOD-LISTS.sh
     71
     72Then move up one directory to the main collection directory and build
     73the collection.
     74
     75To build the full collection, the preparation sequence is:
     76
     77    ./01-DOWNLOAD-ESC-LOD-DATA.sh
     78   
     79    ./02-EXPLODE-SPARQLRESULTS-TO-IMPORT.sh
     80   
     81    ./03-GEN-VOTING-METADATA.sh
     82   
     83    ./04-COPY-VOTING-METADATA-TO-IMPORT.sh
     84   
     85    ./05-PARSE-ADDITIONAL-METADATA-FROM-WIKIPEDIA.sh
     86   
     87    ./06-COPY-PARSED-ADDITIONAL-METADATA-TO-IMPORT.sh
     88   
     89    ./07a-DOWNLOAD-SPOTIFY-LOD-DATA.sh
     90   
     91    ./08a-EXPLODE-SPOTIFY-SPARQLRESULTS-TO-IMPORT.sh
     92   
     93    ./09-GEN-PROBLEM-LOD-LISTS.sh
    3994
    4095
     
    4297
    4398
     99
     100
Note: See TracChangeset for help on using the changeset viewer.