Timeline



2024-02-08:

18:53 Changeset [38728] by davidb
Updated to dynamically add in JPEG2000 jars, if present of the filesystem
18:37 Changeset [38727] by davidb
build needs to be added in also, to keep things exactly the same as …
18:36 Changeset [38726] by davidb
Newer scripts to automate making the pdf-box-java.tar and .zip files
18:35 Changeset [38725] by davidb
Extra print statement added, highlighting javac version being used
18:21 Changeset [38724] by davidb
Copies the extra jars to the directory needed by the Perl code in this …
18:12 Changeset [38723] by davidb
Script based on GS_PDFBox_README.txt that simplifies compiling our …
18:05 Changeset [38722] by davidb
Script to simplify turning the 'source' files in 'java' to be in their …
17:58 Changeset [38721] by davidb
Sub-directory to simplify what it means to compile up pdfbox
17:57 Changeset [38720] by davidb
See README file

2024-02-07:

23:24 Changeset [38719] by davidb
Now managed by a script in the import directory
23:24 Changeset [38718] by davidb
Upgraded to output a simple text list based on doc.xml fgrep
23:18 Changeset [38717] by davidb
To simplfy python install/setup
23:17 Changeset [38716] by davidb
Videos prepared for the willow DL
23:16 Changeset [38715] by davidb
Further note added
23:14 Changeset [38714] by davidb
Updated instructions
17:12 Changeset [38713] by davidb
colon char in debug msg needs escaping
17:11 Changeset [38712] by davidb
colon char in debug msg needs escaping
14:44 Changeset [38711] by davidb
Hand crafted metadata for dictionary
13:53 Changeset [38710] by davidb
Scripts to help with chars in Google Drive that do not get processed …
13:51 Changeset [38709] by davidb
More careful treatment of filenames that get used in a regex context
13:50 Changeset [38708] by davidb
Step to automate working the the Hull Dictioary

2024-02-06:

23:16 Changeset [38707] by davidb
Special case added for pdf-box
19:23 Changeset [38706] by davidb
No longer a script to use. Changing to having a dedicated diretory in …
14:05 Changeset [38705] by davidb
Some files/dirs to ignore
14:04 Changeset [38704] by davidb
filename to regex safe function added
13:27 Changeset [38703] by davidb
Further file/directory patching needed
13:26 Changeset [38702] by davidb
Further file/directory patching needed
13:17 Changeset [38701] by davidb
metadata.xml files now include entries matched against PDF files
13:16 Changeset [38700] by davidb
Patching/Unpatching now changes the awkward long diagonal slash char, …
13:07 Changeset [38699] by davidb
Fixed typo
12:58 Changeset [38698] by davidb
Code introduced to 'paramaterize' the GSDL3SRCHOME part of files saved …

2024-02-05:

11:19 Changeset [38697] by davidb
Updated to work with new filename
11:18 Changeset [38696] by davidb
Prepare scripts for generating metadata for digitised materials …
11:17 Changeset [38695] by davidb
Embedding the unpatch and patch scripts into the main 05 script so …
11:02 Changeset [38694] by davidb
Have this run automatically as part of '05' main script

2024-02-04:

18:08 Changeset [38693] by davidb
Additional metadata fields added
17:58 Changeset [38692] by davidb
Further development: now outputing metadata_xml content to screen
13:07 Changeset [38691] by davidb
Useful script to have around -- note the LANG=C part, so directory …
13:06 Changeset [38690] by davidb
Next testable stage of development -- applying the directory matching rules
13:05 Changeset [38689] by davidb
Tweak to file name
00:27 Changeset [38688] by davidb
Bodge things for now

2024-02-03:

23:55 Changeset [38687] by davidb
Early work on generating item files
22:48 Changeset [38686] by davidb
shortened name
22:41 Changeset [38685] by davidb
needs-item-file now calculated
17:36 Changeset [38684] by davidb
Hyphens preferred
17:35 Changeset [38683] by davidb
Setup brought more into line with other prepare steps
17:26 Changeset [38682] by davidb
Changing to calling this from an all-caps shell script
17:24 Changeset [38681] by davidb
Moved up in the order
16:51 Changeset [38680] by davidb
Moved to a more data-structure driven approach to determining how …
15:41 Changeset [38679] by davidb
Changed over to a rough-cut module

2024-02-02:

18:38 Changeset [38678] by davidb
More tweaking of text info in playbook
18:14 Changeset [38677] by davidb
Tweaks to playbook resulting from basing the willow off of this one
18:13 Changeset [38676] by davidb
Playbook for the willow, imprinted off intermuse
18:05 Changeset [38675] by davidb
added gsdl3srchome being displayed
18:04 Changeset [38674] by davidb
Fixed up task as a result of testing
15:20 Changeset [38673] by davidb
Using a tar-file to avoid having conflicting svn and git version …
15:11 Changeset [38672] by davidb
Using a tar-file to avoid having conflicting svn and git version …
15:08 Changeset [38671] by davidb
New extension to work with lowres lang tools being developed through …
14:29 Changeset [38670] by davidb
Some details on how to get a Google Drive setup with rclone
14:24 Changeset [38669] by davidb
Front end script to get all the digitized content (takes a while); …
14:23 Changeset [38668] by davidb
PDF list saved to file for rsync command use
14:20 Changeset [38667] by davidb
Name change of folder on Google Drive
14:20 Changeset [38666] by davidb
Name change of folder on Google Drive

2024-02-01:

23:40 Changeset [38665] by davidb
Script in development for working out what needs to be copied into the …
11:40 Changeset [38664] by davidb
Changes needed to be able to successfully install ImageMagick on RHEL8
11:39 Changeset [38663] by davidb
Added debug output as a reminder as to what to do next
11:25 Changeset [38662] by davidb
No longer need the reminder message, as now taken care off elsewhere
11:25 Changeset [38661] by davidb
The script to run currently doesn't have 'NEW-' as part of its name. …

2024-01-31:

23:14 Changeset [38660] by davidb
Devel::Peek.pm was not installed, despite perl-devel being installed
22:53 Changeset [38659] by davidb
Further tasks added to complete the installation
22:09 Changeset [38658] by davidb
Changed to be GS3 compatible, rather then GS2 (deprecated)
21:45 Changeset [38657] by davidb
Some initial work on ansible scripting the InterMusE installation
17:41 Changeset [38656] by davidb
Adding in selfcontained-python3. Used in gnome-lib build, and python …
17:33 Changeset [38655] by davidb
Preliminary work on a VM Manager action, imprinted from DepositorAction
17:20 Changeset [38654] by davidb
Changed default values back to a more tradition 83 range
17:20 Changeset [38653] by davidb
Changes after testing on Redhat 8
16:04 Changeset [38652] by davidb
Updated notes for Redhat

2024-01-29:

16:48 Changeset [38651] by davidb
Useful URL added as comment

2024-01-28:

18:46 Changeset [38650] by davidb
Improved integration
18:42 Changeset [38649] by davidb
Directory rename
18:41 Changeset [38648] by davidb
Example code potentially useful in the future
18:40 Changeset [38647] by davidb
More file/dir restructuring
18:39 Changeset [38646] by davidb
change of directory name
18:37 Changeset [38645] by davidb
Scripts restrutured into a sub-directory
18:31 Changeset [38644] by davidb
Scripts for spinning up and provisioning a newly created VM
18:30 Changeset [38643] by davidb
Scripts to get gcloud logged in
14:52 Changeset [38642] by davidb
Deprecating in favour of the new vm-manager extension
14:51 Changeset [38641] by davidb
Dig command added
14:50 Changeset [38640] by davidb
Initial set of CLI scripts, originally developed within …
14:41 Changeset [38639] by davidb
New extension for using gcloud to create/manage GCP VMs

2024-01-26:

17:53 Changeset [38638] by davidb
Expanded to describe and list dns zone data
17:36 Changeset [38637] by davidb
Some notes and an initial script create a DNS zone that can then be …
00:22 Changeset [38636] by davidb
Some rough cut scripts to count non-ascii titles in MongoDB

2024-01-25:

23:47 Changeset [38635] by davidb
Source this from the directory it is located in
23:47 Changeset [38634] by davidb
Version extended to work with concurrency threads
21:33 Changeset [38633] by jc550
add "issued" field to those that will be retrieved from the metadata
17:25 Changeset [38632] by davidb
More tweaks to simplify code, and have it run more constently

2024-01-24:

17:11 Changeset [38631] by davidb
With commented out code removed
17:09 Changeset [38630] by davidb
Reworking of script
14:30 Changeset [38629] by jc550
fix file writing so that file handler is closed upon program exit and …
14:25 Changeset [38628] by jc550
fix typo
14:18 Changeset [38627] by jc550
add program to test title and subtitle equivalence, xref vs openalex

2024-01-23:

14:35 Changeset [38626] by davidb
Needs to be at-symbols
14:33 Changeset [38625] by davidb
A-Record not CNAME
13:45 Changeset [38624] by davidb
More tidying up
13:35 Changeset [38623] by davidb
Added running GS3 into the script
11:52 Changeset [38622] by davidb
Updated notes
11:13 Changeset [38621] by davidb
Initial commit of python packages needed (known to be incomplete, but …
11:12 Changeset [38620] by davidb
Details added on how to get started using the code
10:02 Changeset [38619] by davidb
Minor tweaks to output
09:53 Changeset [38618] by davidb
shorter script name
09:50 Changeset [38617] by davidb
script rename

2024-01-22:

22:27 Changeset [38616] by davidb
script rename
22:26 Changeset [38615] by davidb
Script rename
18:51 Changeset [38614] by davidb
Comment out ufw for now
18:51 Changeset [38613] by davidb
To help spot run away processes started via ssh ansible playbook
18:36 Changeset [38612] by davidb
Putting back to the command version for now, as 'ssh' remote version …
18:09 Changeset [38611] by davidb
Developing capability for scripts on gsvm side to have parameter …
18:08 Changeset [38610] by davidb
Fixed type in @TEMPLATE@ name
17:40 Changeset [38609] by davidb
Changed to a more templating way of doing this
17:37 Changeset [38608] by davidb
(ad hoc) tags to help gcloud scripting
17:18 Changeset [38607] by davidb
Tweak to playbook so the compiling/install ant target displays to the …
16:59 Changeset [38606] by davidb
User GSVM_USER to control user the ansible playbooks run as
16:46 Changeset [38605] by davidb
additional tweaks in response to testing
16:38 Changeset [38604] by davidb
Correctly run scripts
16:37 Changeset [38603] by davidb
Fixed typo in default assignment
16:26 Changeset [38602] by davidb
Updated instructions to run provision-vm-instance.sh
16:25 Changeset [38601] by davidb
Extended to run the scrip just scopyied across
16:24 Changeset [38600] by davidb
Tweak to use more of the values set in _local_config.bash
16:24 Changeset [38599] by davidb
Updated to use new default download name, and then actually run the …
16:23 Changeset [38598] by davidb
echo/info print added
16:19 Changeset [38597] by davidb
Tweak to default download name
16:03 Changeset [38596] by davidb
Run the necessary scp command
16:02 Changeset [38595] by davidb
Rename to reflect that the playbooks are for Greenston3
14:15 Changeset [38594] by davidb
Next round of changes to streamline things further
14:05 Changeset [38593] by davidb
Further directory-file re-structure
14:04 Changeset [38592] by davidb
Further sub-dir structure
14:02 Changeset [38591] by davidb
Moving files into new directory structure
14:00 Changeset [38590] by davidb
directory to hold scripts being developed to create Google VM capabile …
13:58 Changeset [38589] by davidb
Updated to correctly add ssh key metadata

2024-01-19:

18:19 Changeset [38588] by davidb
added extra print statement to indicate what to do next
18:11 Changeset [38587] by davidb
Rough-cut script to keep track of what was run on a Google VM once it …
18:08 Changeset [38586] by davidb
Experiment with using ufw -- had to fix syntax error in when statement
18:07 Changeset [38585] by davidb
Changed to use config variable for port
18:06 Changeset [38584] by davidb
Tweaked back a bit to be more like what the default values will …
17:26 Changeset [38583] by davidb
To help see how far through ant install is
17:01 Changeset [38582] by davidb
Work still in development -- filename chosen so it won't run as a JSP …
16:44 Changeset [38581] by davidb
Added gcloud to the selfcontained fold
16:33 Changeset [38580] by davidb
First cut as prepare and setup scripts for gcloud
16:25 Changeset [38579] by davidb
Initial script to create VM, after some test runs at the command line
14:32 Changeset [38578] by davidb
Updated with gcloud selfcontained extension
14:31 Changeset [38577] by davidb
Some initial files for the extension
14:29 Changeset [38576] by davidb
Top-level directory for Google Cloud/shell CLI extension for Greenstone
14:29 Changeset [38575] by davidb
Top-level directory for Google Cloud/shell CLI extension for Greenstone
13:52 Changeset [38574] by davidb
Tweak to echo output
13:51 Changeset [38573] by davidb
Copy tidy up, removing commented out blocks
13:45 Changeset [38572] by davidb
Copy of the playbook to get Greenstone3 compiled up and deployed over …
13:41 Changeset [38571] by davidb
Playbook extended further to now use certbot to create the https …
11:30 Changeset [38570] by davidb
Changes after a fresh round of testing. Some work also done on …

2024-01-17:

15:43 Changeset [38569] by kjdon
commented out the win31compat option - don;t know why it was still in …

2024-01-16:

22:49 Changeset [38568] by davidb
Logic added to ensure gsdl3servlet_external must use 'https'
22:35 Changeset [38567] by davidb
Commented out entries pondering what to do with opening up firewall ports
22:34 Changeset [38566] by davidb
external context and servlet now default back to internal version
22:21 Changeset [38565] by davidb
Additional tasks added to target commenting/uncomments revproxy lines …
22:20 Changeset [38564] by davidb
break the tasks down into smaller logical units
22:19 Changeset [38563] by davidb
Additional lines of config needed
20:41 Changeset [38562] by jc550
fix syntax error in xRefToMongo.py and add additional field recorded
16:40 Changeset [38561] by anupama
Updated svn externals to include authen-e DEC addition for Italian.
16:35 Changeset [38560] by anupama
Italian language gs3deccolcfg module GS3 interface. Many thanks to …
16:17 Changeset [38559] by davidb
Additional set_facts added for composite domain_url
16:15 Changeset [38558] by anupama
Noticed I hadn't generated the Gujarati gli help files last time. …
16:13 Changeset [38557] by anupama
Removing temporary file
16:12 Changeset [38556] by davidb
Restructuring of cofig vars
16:09 Changeset [38555] by anupama
Italian language glihelp GS interface. Many thanks to Julian Fox.
16:00 Changeset [38554] by anupama
Spanish language gsinstaller module. Many thanks to Diego Spano.
15:58 Changeset [38553] by anupama
Spanish language glidict module. Many thanks to Diego Spano.
15:56 Changeset [38552] by anupama
Spanish language perllib module. Many thanks to Diego Spano.
15:54 Changeset [38551] by anupama
Italian language gs3interface module. Many thanks to Julian Fox.
15:54 Changeset [38550] by anupama
Spanish language gs3interface module. Many thanks to Diego Spano.
15:51 Changeset [38549] by anupama
French language gs3interface module. Many thanks to Yvan Arnaud.
15:39 Changeset [38548] by anupama
Italian language auxdm module GS interface. Many thanks to Julian Fox.
15:17 Changeset [38547] by anupama
My previous commit's bugfix didn't work a couple of complex …
13:13 Changeset [38546] by davidb
Additional note added on how to use

2024-01-15:

16:33 Changeset [38545] by jc550
start working on time-series python script and add more fields to the …
11:26 Changeset [38544] by jc550
add more comments and remove unused function

2024-01-13:

11:03 Changeset [38543] by davidb
echo statements added to detail what to do next
11:00 Changeset [38542] by davidb
Getting the Apache2 reverse proxy going
11:00 Changeset [38541] by davidb
Getting the Apache2 reverse proxy going
10:59 Changeset [38540] by davidb
Whitespace add
10:58 Changeset [38539] by davidb
A script to help bootstrap things

2024-01-12:

17:09 Changeset [38538] by davidb
Further tidy up
17:09 Changeset [38537] by davidb
Values that stress test a playbook build
16:42 Changeset [38536] by davidb
Change of filename
16:39 Changeset [38535] by davidb
Adding in shared variables to ansible playbook
16:34 Changeset [38534] by davidb
Adding in shared variables to ansible playbook
14:39 Changeset [38533] by jc550
add progress bar and fix exception handling
14:14 Changeset [38532] by jc550
add exception handling to xRefToMongo.py so that all files can be …
13:53 Changeset [38531] by davidb
More systematic naming convension
13:51 Changeset [38530] by davidb
Putting the gsdl3srchome variable back to a logical default value
13:22 Changeset [38529] by davidb
This logic has been merged into greenstone3-svn-playbook.yml
13:20 Changeset [38528] by davidb
Script improvements/tidy-up
11:51 Changeset [38527] by davidb
Fixed typo
11:48 Changeset [38526] by davidb
Further refinements
11:48 Changeset [38525] by davidb
Changed to run as current user
10:43 Changeset [38524] by davidb
Further refinement of playback as a result of testing
09:13 Changeset [38523] by davidb
Tweak after testing

2024-01-11:

17:33 Changeset [38522] by davidb
Some initial work on using ansible to svn checkout and compile up …
15:14 Changeset [38521] by davidb
Safer to do sourcing with '.', rather than 'source' which is actually …
13:24 Changeset [38520] by davidb
Nascent 2nd task added to compile up Greenstone3
13:23 Changeset [38519] by davidb
Default values used in playbook
11:49 Changeset [38518] by davidb
Some inital work developing ansible playbooks to compile up and …

2024-01-10:

13:55 Changeset [38517] by jc550
add more comments to xRefToMongo.py
13:32 Changeset [38516] by jc550
finish basic functionality of convert directory
11:29 Changeset [38515] by davidb
Changing from PNG to JPEG
11:27 Changeset [38514] by davidb
command-line logic to ensure the gs3-table-proxy servlet is compiled …
10:48 Changeset [38513] by davidb
DOS bat version developed when working on the interative table.
10:46 Changeset [38512] by davidb
Extra checking added in
10:44 Changeset [38511] by davidb
Mistakenly committed to the main source code. Local copies have been …
Note: See TracTimeline for information about the timeline view.