Timeline



2016-10-30:

23:51 Changeset [31001] by davidb
Code to work per-volume and per-page
22:51 Changeset [31000] by davidb
Class name refactoring
22:50 Changeset [30999] by davidb
Class name refactoring
22:49 Changeset [30998] by davidb
Class name refactoring
22:49 Changeset [30997] by davidb
Verbosity control over printing
22:25 Changeset [30996] by davidb
Code refactoring
21:43 Changeset [30995] by davidb
Adjustment of NUM_PARTITIONS to be based on Spark recommended calculation
17:22 Changeset [30994] by davidb
Additional useful links. Links open in new tab
17:10 Changeset [30993] by davidb
Placeholder page to provide useful links to hadoop and solr cluster …
15:49 Changeset [30992] by davidb
Additional adjustments after test run on cluster
15:41 Changeset [30991] by davidb
Inital cut at README notes, and supporting links
11:39 Changeset [30990] by davidb
opt name change
11:37 Changeset [30989] by davidb
Changes to better suit EF set used with solr
11:32 Changeset [30988] by davidb
Changed flag to 'read-only' and changed the filed name full text saved …
09:35 Changeset [30987] by Georgiy Litvinov
Fixed different size in hierarchy button and li element

2016-10-29:

16:57 Changeset [30986] by davidb
Debugging for double accumulator added
16:17 Changeset [30985] by davidb
Changed to run main processing method as action rather than transform. …
15:45 Changeset [30984] by davidb
Introduction of Spark accumulator to measure progress. Output of POST …

2016-10-28:

18:10 Changeset [30983] by davidb
Useful helper script
18:09 Changeset [30982] by davidb
Fixed to host_name for solr2 and solr3
17:53 Changeset [30981] by davidb
Useful folder for 'on-the-side' packages
15:15 Changeset [30980] by davidb
Code added to read response
14:44 Changeset [30979] by davidb
_solr_url needs to be stored in class!
14:40 Changeset [30978] by davidb
Additional debug statements
14:35 Changeset [30977] by davidb
Only have RDD if an output directory was specified on the command-line …
14:32 Changeset [30976] by davidb
Change to reflect changed order of command-line arguments
14:28 Changeset [30975] by davidb
Introduction of new solr-url command line argument, leading to some …
13:47 Changeset [30974] by davidb
update/add/doc JSON structure needed
11:53 Changeset [30973] by davidb
Changed to saving Solr JSON file for debugging purposes
11:46 Changeset [30972] by davidb
addition of useful command needed before re-running
11:35 Changeset [30971] by davidb
Adding in post to Solr cloud. Changed text_t to _text_
11:10 Changeset [30970] by davidb
Added in mapping of EF-JSON to Solr 'add' JSON format

2016-10-27:

23:09 Changeset [30969] by davidb
Fine tuning resulting from testing the cloud/cluster
17:59 Changeset [30968] by ak19
Correction to regex expression used in sed in z3950 Makefile: what …
17:55 Changeset [30967] by ak19
Correction to regex expression used in sed in z3950 Makefile: what …
17:50 Changeset [30966] by ak19
Adding in lbz2 (lib BZIP2) to the list of libraries in the GNUMakefile …
16:44 Changeset [30965] by ak19
Further clarification
16:40 Changeset [30964] by ak19
Clarification in README
16:39 Changeset [30963] by ak19
Updated gnome-lib-minimal for 64 bit linux after the changes to …
16:08 Changeset [30962] by davidb
Corrections and improvements made after initial testing between …
15:51 Changeset [30961] by ak19
Dr Bainbridge got the new yaz to compile on the Mac Mountain Lion again.
14:08 Changeset [30960] by davidb
Switch to using Puppet to provision machine. Strongly based on files …
13:25 Changeset [30959] by kjdon
Made the ConfigEditor modal so that people can't be editing the format …
11:43 Changeset [30958] by kjdon
in DocumentMetadataRetrieve, this was creating a paramlist with …

2016-10-26:

22:58 Changeset [30957] by davidb
No longer needed. (Local copy taken on Windows laptop.)
22:55 Changeset [30956] by davidb
Initial commit of files for setting up with Vagrant a Solr cloud
18:40 Changeset [30955] by ak19
New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs …
18:39 Changeset [30954] by ak19
New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs …
18:00 Changeset [30953] by davidb
Need to specify _output_dir as part of output JSON filename
18:00 Changeset [30952] by davidb
Further text tidy up
17:54 Changeset [30951] by davidb
Save a JSONObject as a file in the output directory
17:41 Changeset [30950] by davidb
Tweak to text
17:40 Changeset [30949] by davidb
Use better name than 'foo'. Further fix to JSON name generated
17:25 Changeset [30948] by ak19
Changes in z3950 and recpt Makefile to get dependencies right for …
17:24 Changeset [30947] by davidb
Correction to 'pages-' part of JSON.bz2 output filename used
15:47 Changeset [30946] by davidb
Correction to output JSON.bz2 name generated
15:37 Changeset [30945] by davidb
Getting closer to writing out JSON files
14:47 Changeset [30944] by davidb
Forcer higher partition (6) than default, which seems to be 2
14:39 Changeset [30943] by davidb
Extra debug info
14:27 Changeset [30942] by davidb
Improved output printing for slave node
14:16 Changeset [30941] by davidb
Moved to getFileSystemInstance() method to play nice on cluster
14:01 Changeset [30940] by davidb
Change to using URI not fileIn directly
13:57 Changeset [30939] by davidb
Minor tweaks
13:53 Changeset [30938] by davidb
Experiment with using Hadoop's FileSystem class for local file:// access
13:44 Changeset [30937] by davidb
Expanded set of ClusterFileIO methods
11:11 Changeset [30936] by davidb
Refinement of Spark Monitor echo statements
11:09 Changeset [30935] by davidb
Fixed variable name typo, plus added a couple of 'sleep' pauses of 1 sec
11:05 Changeset [30934] by davidb
Providing json-filelist now a compulsory argument, rather than an option
10:24 Changeset [30933] by davidb
More careful parsing of file prefix
10:16 Changeset [30932] by davidb
Support both file:// and hdfs://
09:58 Changeset [30931] by davidb
Version that runs using fil:// tested
09:50 Changeset [30930] by davidb
Expansion of useful alias commands for Hadoop and Spark
09:47 Changeset [30929] by davidb
Tweaks made while testing the script
09:15 Changeset [30928] by davidb
Forgot to set json_filelist
09:12 Changeset [30927] by davidb
Fixed silly typo in stdout redirect
09:09 Changeset [30926] by davidb
Restructuring of RUN scripts to be more flexible

2016-10-25:

23:49 Changeset [30925] by davidb
Improved instrutions
23:49 Changeset [30924] by davidb
Tidy up of code. Removed commented out code
23:28 Changeset [30923] by davidb
Rough cut version that reads in each JSON file over HDFS
23:27 Changeset [30922] by davidb
Additional rough-cut notes
23:23 Changeset [30921] by davidb
Code change to read in JSON file over HDFS
16:46 Changeset [30920] by ak19
Dr Bainbridge got the z3950 server compiled up again against the …
14:52 Changeset [30919] by davidb
More consistent naming of folders used
14:49 Changeset [30918] by davidb
More flexible command-line args
14:20 Changeset [30917] by davidb
Changes resulting from a fresh run at provisioning, which yielded the …
13:44 Changeset [30916] by davidb
Some additional details -- note form
13:32 Changeset [30915] by davidb
Initial cut at instructions to follow to get code set up and running
11:27 Changeset [30914] by davidb
Tidy up of setup description
10:02 Changeset [30913] by davidb
Renaming to better represent what the cluster is designed for

2016-10-24:

15:55 Changeset [30912] by davidb
Changed to Unix style line-endings
15:54 Changeset [30911] by davidb
Changed name of input directory
15:40 Changeset [30910] by davidb
Additional finesse added in as a result of further testing on Vagrant …
15:39 Changeset [30909] by davidb
Additional finesse added in as a result of further testing on Vagrant …
15:39 Changeset [30908] by davidb
Additional finesse added in as a result of further testing on Vagrant …

2016-10-23:

22:08 Changeset [30907] by davidb
Name change to reflect need for 'bash' not 'sh'
22:05 Changeset [30906] by davidb
Bash version of BAT script
18:32 Changeset [30905] by davidb
Additional resources
18:19 Changeset [30904] by davidb
Extra resource/links added
18:11 Changeset [30903] by davidb
Vagrant provisioning files for a 4-node Hadoop cluster. See …

2016-10-22:

19:06 Changeset [30902] by davidb
Details of what packages are needed
16:33 Changeset [30901] by davidb
Template setup file
16:30 Changeset [30900] by davidb
For support Java packages
16:29 Changeset [30899] by davidb
Files for compilation using Eclipse
16:28 Changeset [30898] by davidb
Scripts for downloading sample JSON data from public domain extracted …
16:26 Changeset [30897] by davidb
Sub-project for converted HTRC Extract Feature dataset into a form …

2016-10-21:

18:18 Changeset [30896] by ak19
Fixing error in commit.
16:59 Changeset [30895] by ak19
Tidier way to set LDFLAGS and not exporting it this time, in case it …
16:52 Changeset [30894] by ak19
Experimenting to get gnome-lib-minimal sourced at the right time for …

2016-10-20:

16:15 Changeset [30893] by ak19
Dr Bainbridge made a fix to yaz to get it to compile again: had to …
15:47 Changeset [30892] by ak19
Undoing yesterday's commit. Removing libz's dylib files to leave just …
10:34 Changeset [30891] by kjdon
removed some commented out code. when looking up metadata, if we have …
09:33 Changeset [30890] by davidb
folder to group together hathitrust related projects
00:20 Changeset [30889] by Georgiy Litvinov
Fix corrputing html by empty classifier

2016-10-19:

20:46 Changeset [30888] by ak19
Committing ElCap version of gnome-lib-minimal without the dylib …
20:26 Changeset [30887] by ak19
Updating gnome-lib-minimal tar gz for Mountain Lion after recent …
19:27 Changeset [30886] by ak19
Corrections to previous commit
18:49 Changeset [30885] by ak19
In order to get the relsase working on Mac ElCapitan, getting wvware …
17:06 Changeset [30884] by ak19
Undoing previous commit
16:35 Changeset [30883] by ak19
Experimenting to get libwv to be compiled up correctly on ElCapitan so …

2016-10-18:

19:33 Changeset [30882] by ak19
Committing modified gnome-lib-minimal tar gz file for ElCapitan. If …
19:28 Changeset [30881] by ak19
Adding in disable-shared and enable-static flags to the configure step …
17:22 Changeset [30880] by ak19
Some more additions to the new tutorial on incr building.
16:52 Changeset [30879] by ak19
Modifications to get GS2 compiling to work again on Macs after the …
16:52 Changeset [30878] by ak19
Modifications to get GS2 compiling to work again on Macs after the …

2016-10-17:

19:22 Changeset [30877] by ak19
Dr Bainbridge added an intro and conclusion, and the skeleton of …
17:01 Changeset [30876] by ak19
Removed the UNUSED folder of unused bins from imagemagick tar file for Mac
15:30 Changeset [30875] by ak19
Renamed the new incr-build sample_files subfolder to incr_build (with …
15:04 Changeset [30874] by ak19
Forgot to commit sample files for new tutorial on cmdline incremental …
14:13 Changeset [30873] by ak19
Making some instructions more explicit.
14:05 Changeset [30872] by ak19
Updated the gnome-lib-minimal.tar.gz for ElCapitan Mac to incorporate …
11:49 Changeset [30871] by kjdon
need xmlns:gslib in header so that we can use gslib elements in config file
11:48 Changeset [30870] by kjdon
adding xmlns:gslib into the root tags
11:48 Changeset [30869] by kjdon
we need to have xmlns:gslib in the main element
09:54 Changeset [30868] by kjdon
removed a heap of hat-Ms, and modified the gsf:if-metadata-exists …

2016-10-14:

20:43 Changeset [30867] by ak19
Used a linux machine to run autoconf on the modified configure.in just …
20:41 Changeset [30866] by ak19
GSDLOS variable wasn't being set in configure.in and hence wasn't …
19:45 Changeset [30865] by ak19
Undoing experimental commits 30786-30793
19:33 Changeset [30864] by ak19
Undoing experimental commits 30786-30793
19:02 Changeset [30863] by ak19
Changes to get libiconv issues on MacOS El Capitan straightened out, …
18:24 Changeset [30862] by ak19
Changes to get libiconv issues on MacOS El Capitan straightened out, …

2016-10-13:

13:12 Changeset [30861] by kjdon
created a new template named coll-description for easier customization
13:08 Changeset [30860] by kjdon
added in formatTimestamp method to convert a timestamp to human …

2016-10-10:

14:48 Changeset [30859] by kjdon
added a template for displaying collection metadata: eg …
14:42 Changeset [30858] by kjdon
output buildDate into the buildConfig.xml (to match builddate in gs2)

2016-10-07:

16:38 Changeset [30857] by ak19
Unless new line endings (particularly carriage return characters …

2016-10-06:

18:42 Changeset [30856] by ak19
First commit of the formatted (for tutorials) version of the GS3 …
17:12 Changeset [30855] by ak19
Dutch translations for the core module of the GS2 interface. Many …
Note: See TracTimeline for information about the timeline view.