source:

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @30960   7 years davidb Switch to using Puppet to provision machine. Strongly based on files …
(edit) @30959   7 years kjdon Made the ConfigEditor modal so that people can't be editing the format …
(edit) @30958   7 years kjdon in DocumentMetadataRetrieve, this was creating a paramlist with …
(edit) @30957   7 years davidb No longer needed. (Local copy taken on Windows laptop.)
(edit) @30956   7 years davidb Initial commit of files for setting up with Vagrant a Solr cloud
(edit) @30955   7 years ak19 New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs …
(edit) @30954   7 years ak19 New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs …
(edit) @30953   7 years davidb Need to specify _output_dir as part of output JSON filename
(edit) @30952   7 years davidb Further text tidy up
(edit) @30951   7 years davidb Save a JSONObject as a file in the output directory
(edit) @30950   7 years davidb Tweak to text
(edit) @30949   7 years davidb Use better name than 'foo'. Further fix to JSON name generated
(edit) @30948   7 years ak19 Changes in z3950 and recpt Makefile to get dependencies right for …
(edit) @30947   7 years davidb Correction to 'pages-' part of JSON.bz2 output filename used
(edit) @30946   7 years davidb Correction to output JSON.bz2 name generated
(edit) @30945   7 years davidb Getting closer to writing out JSON files
(edit) @30944   7 years davidb Forcer higher partition (6) than default, which seems to be 2
(edit) @30943   7 years davidb Extra debug info
(edit) @30942   7 years davidb Improved output printing for slave node
(edit) @30941   7 years davidb Moved to getFileSystemInstance() method to play nice on cluster
(edit) @30940   7 years davidb Change to using URI not fileIn directly
(edit) @30939   7 years davidb Minor tweaks
(edit) @30938   7 years davidb Experiment with using Hadoop's FileSystem class for local ​file:// access
(edit) @30937   7 years davidb Expanded set of ClusterFileIO methods
(edit) @30936   7 years davidb Refinement of Spark Monitor echo statements
(edit) @30935   7 years davidb Fixed variable name typo, plus added a couple of 'sleep' pauses of 1 sec
(edit) @30934   7 years davidb Providing json-filelist now a compulsory argument, rather than an option
(edit) @30933   7 years davidb More careful parsing of file prefix
(edit) @30932   7 years davidb Support both ​file:// and hdfs://
(edit) @30931   7 years davidb Version that runs using fil:// tested
(edit) @30930   7 years davidb Expansion of useful alias commands for Hadoop and Spark
(edit) @30929   7 years davidb Tweaks made while testing the script
(edit) @30928   7 years davidb Forgot to set json_filelist
(edit) @30927   7 years davidb Fixed silly typo in stdout redirect
(edit) @30926   7 years davidb Restructuring of RUN scripts to be more flexible
(edit) @30925   7 years davidb Improved instrutions
(edit) @30924   7 years davidb Tidy up of code. Removed commented out code
(edit) @30923   7 years davidb Rough cut version that reads in each JSON file over HDFS
(edit) @30922   7 years davidb Additional rough-cut notes
(edit) @30921   7 years davidb Code change to read in JSON file over HDFS
(edit) @30920   7 years ak19 Dr Bainbridge got the z3950 server compiled up again against the …
(edit) @30919   7 years davidb More consistent naming of folders used
(edit) @30918   7 years davidb More flexible command-line args
(edit) @30917   7 years davidb Changes resulting from a fresh run at provisioning, which yielded the …
(edit) @30916   7 years davidb Some additional details -- note form
(edit) @30915   7 years davidb Initial cut at instructions to follow to get code set up and running
(edit) @30914   7 years davidb Tidy up of setup description
(edit) @30913   7 years davidb Renaming to better represent what the cluster is designed for
(edit) @30912   7 years davidb Changed to Unix style line-endings
(edit) @30911   7 years davidb Changed name of input directory
(edit) @30910   7 years davidb Additional finesse added in as a result of further testing on Vagrant …
(edit) @30909   7 years davidb Additional finesse added in as a result of further testing on Vagrant …
(edit) @30908   7 years davidb Additional finesse added in as a result of further testing on Vagrant …
(edit) @30907   7 years davidb Name change to reflect need for 'bash' not 'sh'
(edit) @30906   7 years davidb Bash version of BAT script
(edit) @30905   7 years davidb Additional resources
(edit) @30904   7 years davidb Extra resource/links added
(edit) @30903   7 years davidb Vagrant provisioning files for a 4-node Hadoop cluster. See …
(edit) @30902   7 years davidb Details of what packages are needed
(edit) @30901   7 years davidb Template setup file
(edit) @30900   7 years davidb For support Java packages
(edit) @30899   7 years davidb Files for compilation using Eclipse
(edit) @30898   7 years davidb Scripts for downloading sample JSON data from public domain extracted …
(edit) @30897   7 years davidb Sub-project for converted HTRC Extract Feature dataset into a form …
(edit) @30896   7 years ak19 Fixing error in commit.
(edit) @30895   7 years ak19 Tidier way to set LDFLAGS and not exporting it this time, in case it …
(edit) @30894   7 years ak19 Experimenting to get gnome-lib-minimal sourced at the right time for …
(edit) @30893   7 years ak19 Dr Bainbridge made a fix to yaz to get it to compile again: had to …
(edit) @30892   7 years ak19 Undoing yesterday's commit. Removing libz's dylib files to leave just …
(edit) @30891   7 years kjdon removed some commented out code. when looking up metadata, if we have …
(edit) @30890   7 years davidb folder to group together hathitrust related projects
(edit) @30889   7 years Georgiy Litvinov Fix corrputing html by empty classifier
(edit) @30888   7 years ak19 Committing ElCap version of gnome-lib-minimal without the dylib …
(edit) @30887   7 years ak19 Updating gnome-lib-minimal tar gz for Mountain Lion after recent …
(edit) @30886   7 years ak19 Corrections to previous commit
(edit) @30885   7 years ak19 In order to get the relsase working on Mac ElCapitan, getting wvware …
(edit) @30884   7 years ak19 Undoing previous commit
(edit) @30883   7 years ak19 Experimenting to get libwv to be compiled up correctly on ElCapitan so …
(edit) @30882   7 years ak19 Committing modified gnome-lib-minimal tar gz file for ElCapitan. If …
(edit) @30881   7 years ak19 Adding in disable-shared and enable-static flags to the configure step …
(edit) @30880   7 years ak19 Some more additions to the new tutorial on incr building.
(edit) @30879   7 years ak19 Modifications to get GS2 compiling to work again on Macs after the …
(edit) @30878   7 years ak19 Modifications to get GS2 compiling to work again on Macs after the …
(edit) @30877   8 years ak19 Dr Bainbridge added an intro and conclusion, and the skeleton of …
(edit) @30876   8 years ak19 Removed the UNUSED folder of unused bins from imagemagick tar file for Mac
(edit) @30875   8 years ak19 Renamed the new incr-build sample_files subfolder to incr_build (with …
(edit) @30874   8 years ak19 Forgot to commit sample files for new tutorial on cmdline incremental …
(edit) @30873   8 years ak19 Making some instructions more explicit.
(edit) @30872   8 years ak19 Updated the gnome-lib-minimal.tar.gz for ElCapitan Mac to incorporate …
(edit) @30871   8 years kjdon need xmlns:gslib in header so that we can use gslib elements in config file
(edit) @30870   8 years kjdon adding xmlns:gslib into the root tags
(edit) @30869   8 years kjdon we need to have xmlns:gslib in the main element
(edit) @30868   8 years kjdon removed a heap of hat-Ms, and modified the gsf:if-metadata-exists …
(edit) @30867   8 years ak19 Used a linux machine to run autoconf on the modified configure.in just …
(edit) @30866   8 years ak19 GSDLOS variable wasn't being set in configure.in and hence wasn't …
(edit) @30865   8 years ak19 Undoing experimental commits 30786-30793
(edit) @30864   8 years ak19 Undoing experimental commits 30786-30793
(edit) @30863   8 years ak19 Changes to get libiconv issues on MacOS El Capitan straightened out, …
(edit) @30862   8 years ak19 Changes to get libiconv issues on MacOS El Capitan straightened out, …
(edit) @30861   8 years kjdon created a new template named coll-description for easier customization
Note: See TracRevisionLog for help on using the revision log.