source: main/trunk/model-sites-dev/eurovision-lod/collect/eurovision/prepare

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @35985   2 years davidb Now run from a bash script, so environment variable can be set
(edit) @35983   2 years davidb Fixed typo in script name
(edit) @35982   2 years davidb Check introduced avoid doing costly SPARQL query if .json file already …
(edit) @35981   2 years davidb Check for _local_prepare_config.sh file
(edit) @35980   2 years davidb Need to make dir if does not exist
(edit) @35979   2 years davidb echo tweak
(edit) @35978   2 years davidb newline echo
(edit) @35976   2 years davidb echo tidyup
(edit) @35970   2 years davidb echo tweak
(edit) @35969   2 years davidb One extra missing category entry found
(edit) @35968   2 years davidb One extra missing category entry found
(edit) @35967   2 years davidb Now working with all-caps on 3letter title disambiguation for better …
(edit) @35966   2 years davidb Even more deprecatedsvn mv RUN.sh RUN--DEPRECATED.sh
(edit) @35965   2 years davidb Now deprecated
(edit) @35964   2 years davidb Comment added
(edit) @35963   2 years davidb Make use of cutoff value
(edit) @35962   2 years davidb Forcing of 2021 files should no longer be needed
(edit) @35961   2 years davidb Improvements to the running of the script, and its underlying Python …
(edit) @35949   2 years davidb Now calls the python script directly
(edit) @35948   2 years davidb variable added to represent the final-year cutoff of Eurovision to …
(edit) @35947   2 years davidb Restructuring of how pythong command-line arguments are supplied; …
(edit) @35946   2 years davidb Further improvments/flexibility
(edit) @35945   2 years davidb Further improvements and flexibility
(edit) @35944   2 years davidb Echo print tidy up
(edit) @35942   2 years davidb Change to using the (now) more generalized version of the script
(edit) @35941   2 years davidb Extra echo statements added in to better detail what if occuring
(edit) @35940   2 years davidb Details updated
(edit) @35939   2 years davidb Code tidyup
(edit) @35938   2 years davidb Change to this being in a '.in' template form
(edit) @35937   2 years davidb Echo block added in to help remember that …
(edit) @35935   2 years davidb Fixed typo in echo instruction
(edit) @35926   2 years davidb Added in directory to igmore
(edit) @35925   2 years davidb Files produced by running 07a-DOWNLOAD-SPOTIFY-LOD-DATA.sh; committed …
(edit) @35924   2 years davidb Some directories to ignore
(edit) @35923   2 years davidb Updated result of running SPARQL query of the same name, as it now …
(edit) @35922   2 years davidb Filter adjusted to include 2021, but not 2020 (where no contesnt ran)
(edit) @35921   2 years davidb Generated file running 03-GEN-VOTING-METADATA.sh; latest version …
(edit) @35916   2 years davidb Snapshot of file generated by 03-GEN-VOTING-METADATA.sh
(edit) @35915   2 years davidb Some dirs to ignore
(edit) @35914   2 years davidb Some dirs to ignore
(edit) @35913   2 years davidb Update on missing entries
(edit) @35912   2 years davidb Bespoke script to run script on 8 core in parallel in background (nohup)
(edit) @35911   2 years davidb Latest versions
(edit) @35910   2 years davidb Updating to freshly generated version, run Jan 2022. …
(edit) @35909   2 years davidb Changed year filter to include 2021, but rule out 2020
(edit) @35908   2 years davidb 2021 errata data added in
(edit) @35907   2 years davidb Fixed directory file arg
(edit) @35906   2 years davidb Minor upgrades
(edit) @35905   2 years davidb Adding in generation of gsf-headMetaTags.xml file, rather then simply …
(edit) @35904   2 years davidb Fixed error in just-year filename; improved info in echo statement
(edit) @35903   2 years davidb Ignore the older excel file up to 2019
(edit) @35895   2 years davidb Info on stages printed out; fixed PATH setenv
(edit) @35894   2 years davidb Changed to actually now do the file copy
(edit) @35891   2 years davidb Changes to support track-a and track-b variations; track-b is the default
(edit) @35890   2 years davidb Fixed up trailing whitespace issue after \
(edit) @35889   2 years davidb Support for command-line start and end years added in
(edit) @35888   2 years davidb Version to allow targetted set of years to be run (2015 by default)
(edit) @35887   2 years davidb Changed so different stages can be run; small version that targets …
(edit) @35886   2 years davidb Code tidy up. Old, in-line, way for querying added back in as a …
(edit) @35882   2 years davidb Script adjusted to run TTL file in the errata-lod dir (which …
(edit) @35881   2 years davidb Script broght into line with (now deprecated) version in errata-lod/; …
(edit) @35880   2 years davidb Version of script now one directory level higher
(edit) @35879   2 years davidb No longer used
(edit) @35878   2 years davidb Further development of script. Now at the point of printing out what …
(edit) @35877   2 years davidb Ignore the 'just' files that SMALL generates
(edit) @35876   2 years davidb Comments now moved to in README-SPARQL.txt
(edit) @35875   2 years davidb Details added about uploading the errata TTL triples
(edit) @35874   2 years davidb Script that needs to be run (one time) at start of prepare process to …
(edit) @35873   2 years davidb Additional id to check needed due to Wikipedia web page changes
(edit) @35872   2 years davidb Artist now handled as Creator
(edit) @35871   2 years davidb Some initial work using the github project 'eurovision-dataset' to use …
(edit) @35870   2 years davidb Initial work on getting the audio features computed JSON files into …
(edit) @35869   2 years davidb Summarized some of the details given, as now covered off by a ALL-CAPS …
(edit) @35868   2 years davidb Script that shows which missing-cat '.nul' files actually exist in the …
(edit) @35867   2 years davidb Details for sub-project to generate audio features using Essentia added
(edit) @35866   2 years davidb Latest version produced by running SPARQL queries against DBpedia
(edit) @35865   2 years davidb A JSON file of the same form can be in the import directory, so need …
(edit) @35864   2 years davidb Generate some info that indicates how well the SPARQL retrieval has …
(edit) @35863   2 years davidb Notes relating to more fiddly bits of getting things going
(edit) @35862   2 years davidb Extended to support startyear and endyear
(edit) @35861   2 years davidb Convenience scripts
(edit) @35854   2 years davidb Useful details around the SPARQL querying part of this project
(edit) @35853   2 years davidb Convenience script to remove log files
(edit) @35852   2 years davidb Fixed the 'collectdir' value so it works in any Geenstone3 site/col …
(edit) @35851   2 years davidb Extended so it can take a year as a parameter on the command line; if …
(edit) @35850   2 years davidb Some addition print text added highlighting the length of time the …
(edit) @35849   2 years davidb Used as a template to generate a query that restricts entries to a …
(edit) @35848   2 years davidb Brackets in URI need to be escaped
(edit) @35847   2 years davidb New errata entries added in response to a fresh full build in early …
(edit) @35846   2 years davidb Version of query that targets just entries in 2015
(edit) @35845   2 years davidb More details over what to do
(edit) @35844   2 years davidb Text covering what to do
(edit) @35843   2 years davidb Some minor upgrades and tweaks to echo statements
(edit) @35842   2 years davidb Introduction of scripts for building a 'small' collection (based on …
(edit) @35840   2 years davidb Local settings shared across the main scripts
(edit) @35836   2 years davidb Name change to allow for parallel ('b') track of scripts for getting …
(edit) @35835   2 years davidb Name change to allow for parallel ('b') track of scripts for getting …
(edit) @35185   3 years davidb Code updated to work with 2021 data
(edit) @35184   3 years davidb New spreadsheet added with 2021 results in it
(edit) @35141   3 years davidb Version of David W's spotify/musicbrainze alignment code use for the …
Note: See TracRevisionLog for help on using the revision log.