Timeline


and .

01.11.2016:

23:46 Changeset [31023] by litvinovg
More modifications to hierarchy webeditor
14:14 Changeset [31022] by davidb
No longer used
14:14 Changeset [31021] by davidb
Folder restructure to remove 'trunk' part
14:13 Changeset [31020] by davidb
No longer used
14:12 Changeset [31019] by davidb
Part 2 or two-step folder restructure
14:10 Changeset [31018] by davidb
Part 1 or two-step folder restructure
14:08 Changeset [31017] by davidb
Moved to correct position
14:07 Changeset [31016] by davidb
No longer used
14:06 Changeset [31015] by davidb
Restructuring of projects into one
07:42 Changeset [31014] by litvinovg
Modified hierarchy js storage, added kjdon fixes.

31.10.2016:

20:51 Changeset [31013] by davidb
Accumulator for PerPageMap?
18:03 Changeset [31012] by ak19
Committing 1. new imagemagick tarball created on Gilda El Capitan (since …
15:40 Changeset [31011] by davidb
Further RDD flatMap/map restructuring and refactoring, for per-page
15:14 Changeset [31010] by davidb
Tidy up on generating Spark App name
15:10 Changeset [31009] by davidb
Adjustments after latest fresh 'vagrant up' trial
09:40 Changeset [31008] by davidb
Additional detail added into Spark app name
09:35 Changeset [31007] by davidb
Class name refactoring
09:27 Changeset [31006] by davidb
Further reversal of Base class. Switch to PerPage?
09:16 Changeset [31005] by davidb
Reversal of Base class in PerVolumeJSON
00:25 Changeset [31004] by davidb
added debug
00:13 Changeset [31003] by davidb
Explicity default constructors added
00:07 Changeset [31002] by davidb
Need to separate flatMap and foreach calls in PagedJSON

30.10.2016:

23:51 Changeset [31001] by davidb
Code to work per-volume and per-page
22:51 Changeset [31000] by davidb
Class name refactoring
22:50 Changeset [30999] by davidb
Class name refactoring
22:49 Changeset [30998] by davidb
Class name refactoring
22:49 Changeset [30997] by davidb
Verbosity control over printing
22:25 Changeset [30996] by davidb
Code refactoring
21:43 Changeset [30995] by davidb
Adjustment of NUM_PARTITIONS to be based on Spark recommended calculation
17:22 Changeset [30994] by davidb
Additional useful links. Links open in new tab
17:10 Changeset [30993] by davidb
Placeholder page to provide useful links to hadoop and solr cluster …
15:49 Changeset [30992] by davidb
Additional adjustments after test run on cluster
15:41 Changeset [30991] by davidb
Inital cut at README notes, and supporting links
11:39 Changeset [30990] by davidb
opt name change
11:37 Changeset [30989] by davidb
Changes to better suit EF set used with solr
11:32 Changeset [30988] by davidb
Changed flag to 'read-only' and changed the filed name full text saved …
09:35 Changeset [30987] by litvinovg
Fixed different size in hierarchy button and li element

29.10.2016:

16:57 Changeset [30986] by davidb
Debugging for double accumulator added
16:17 Changeset [30985] by davidb
Changed to run main processing method as action rather than transform. …
15:45 Changeset [30984] by davidb
Introduction of Spark accumulator to measure progress. Output of POST …

28.10.2016:

18:10 Changeset [30983] by davidb
Useful helper script
18:09 Changeset [30982] by davidb
Fixed to host_name for solr2 and solr3
17:53 Changeset [30981] by davidb
Useful folder for 'on-the-side' packages
15:15 Changeset [30980] by davidb
Code added to read response
14:44 Changeset [30979] by davidb
_solr_url needs to be stored in class!
14:40 Changeset [30978] by davidb
Additional debug statements
14:35 Changeset [30977] by davidb
Only have RDD if an output directory was specified on the command-line …
14:32 Changeset [30976] by davidb
Change to reflect changed order of command-line arguments
14:28 Changeset [30975] by davidb
Introduction of new solr-url command line argument, leading to some other …
13:47 Changeset [30974] by davidb
update/add/doc JSON structure needed
11:53 Changeset [30973] by davidb
Changed to saving Solr JSON file for debugging purposes
11:46 Changeset [30972] by davidb
addition of useful command needed before re-running
11:35 Changeset [30971] by davidb
Adding in post to Solr cloud. Changed text_t to _text_
11:10 Changeset [30970] by davidb
Added in mapping of EF-JSON to Solr 'add' JSON format

27.10.2016:

23:09 Changeset [30969] by davidb
Fine tuning resulting from testing the cloud/cluster
17:59 Changeset [30968] by ak19
Correction to regex expression used in sed in z3950 Makefile: what worked …
17:55 Changeset [30967] by ak19
Correction to regex expression used in sed in z3950 Makefile: what worked …
17:50 Changeset [30966] by ak19
Adding in lbz2 (lib BZIP2) to the list of libraries in the GNUMakefile …
16:44 Changeset [30965] by ak19
Further clarification
16:40 Changeset [30964] by ak19
Clarification in README
16:39 Changeset [30963] by ak19
Updated gnome-lib-minimal for 64 bit linux after the changes to compile up …
16:08 Changeset [30962] by davidb
Corrections and improvements made after initial testing between zookeeper …
15:51 Changeset [30961] by ak19
Dr Bainbridge got the new yaz to compile on the Mac Mountain Lion again.
14:08 Changeset [30960] by davidb
Switch to using Puppet to provision machine. Strongly based on files …
13:25 Changeset [30959] by kjdon
Made the ConfigEditor? modal so that people can't be editing the format …
11:43 Changeset [30958] by kjdon
in DocumentMetadataRetrieve?, this was creating a paramlist with …

26.10.2016:

22:58 Changeset [30957] by davidb
No longer needed. (Local copy taken on Windows laptop.)
22:55 Changeset [30956] by davidb
Initial commit of files for setting up with Vagrant a Solr cloud
18:40 Changeset [30955] by ak19
New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs after …
18:39 Changeset [30954] by ak19
New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs after …
18:00 Changeset [30953] by davidb
Need to specify _output_dir as part of output JSON filename
18:00 Changeset [30952] by davidb
Further text tidy up
17:54 Changeset [30951] by davidb
Save a JSONObject as a file in the output directory
17:41 Changeset [30950] by davidb
Tweak to text
17:40 Changeset [30949] by davidb
Use better name than 'foo'. Further fix to JSON name generated
17:25 Changeset [30948] by ak19
Changes in z3950 and recpt Makefile to get dependencies right for libyaz …
17:24 Changeset [30947] by davidb
Correction to 'pages-' part of JSON.bz2 output filename used
15:47 Changeset [30946] by davidb
Correction to output JSON.bz2 name generated
15:37 Changeset [30945] by davidb
Getting closer to writing out JSON files
14:47 Changeset [30944] by davidb
Forcer higher partition (6) than default, which seems to be 2
14:39 Changeset [30943] by davidb
Extra debug info
14:27 Changeset [30942] by davidb
Improved output printing for slave node
14:16 Changeset [30941] by davidb
Moved to getFileSystemInstance() method to play nice on cluster
14:01 Changeset [30940] by davidb
Change to using URI not fileIn directly
13:57 Changeset [30939] by davidb
Minor tweaks
13:53 Changeset [30938] by davidb
Experiment with using Hadoop's FileSystem? class for local  file:// access
13:44 Changeset [30937] by davidb
Expanded set of ClusterFileIO methods
11:11 Changeset [30936] by davidb
Refinement of Spark Monitor echo statements
11:09 Changeset [30935] by davidb
Fixed variable name typo, plus added a couple of 'sleep' pauses of 1 sec
11:05 Changeset [30934] by davidb
Providing json-filelist now a compulsory argument, rather than an option
10:24 Changeset [30933] by davidb
More careful parsing of file prefix
10:16 Changeset [30932] by davidb
Support both  file:// and  hdfs://
09:58 Changeset [30931] by davidb
Version that runs using  fil:// tested
09:50 Changeset [30930] by davidb
Expansion of useful alias commands for Hadoop and Spark
09:47 Changeset [30929] by davidb
Tweaks made while testing the script
09:15 Changeset [30928] by davidb
Forgot to set json_filelist
09:12 Changeset [30927] by davidb
Fixed silly typo in stdout redirect
09:09 Changeset [30926] by davidb
Restructuring of RUN scripts to be more flexible

25.10.2016:

23:49 Changeset [30925] by davidb
Improved instrutions
23:49 Changeset [30924] by davidb
Tidy up of code. Removed commented out code
23:28 Changeset [30923] by davidb
Rough cut version that reads in each JSON file over HDFS
23:27 Changeset [30922] by davidb
Additional rough-cut notes
23:23 Changeset [30921] by davidb
Code change to read in JSON file over HDFS
16:46 Changeset [30920] by ak19
Dr Bainbridge got the z3950 server compiled up again against the recent …
14:52 Changeset [30919] by davidb
More consistent naming of folders used
14:49 Changeset [30918] by davidb
More flexible command-line args
14:20 Changeset [30917] by davidb
Changes resulting from a fresh run at provisioning, which yielded the …
13:44 Changeset [30916] by davidb
Some additional details -- note form
13:32 Changeset [30915] by davidb
Initial cut at instructions to follow to get code set up and running
11:27 Changeset [30914] by davidb
Tidy up of setup description
10:02 Changeset [30913] by davidb
Renaming to better represent what the cluster is designed for

24.10.2016:

15:55 Changeset [30912] by davidb
Changed to Unix style line-endings
15:54 Changeset [30911] by davidb
Changed name of input directory
15:40 Changeset [30910] by davidb
Additional finesse added in as a result of further testing on Vagrant …
15:39 Changeset [30909] by davidb
Additional finesse added in as a result of further testing on Vagrant …
15:39 Changeset [30908] by davidb
Additional finesse added in as a result of further testing on Vagrant …

23.10.2016:

22:08 Changeset [30907] by davidb
Name change to reflect need for 'bash' not 'sh'
22:05 Changeset [30906] by davidb
Bash version of BAT script
18:32 Changeset [30905] by davidb
Additional resources
18:19 Changeset [30904] by davidb
Extra resource/links added
18:11 Changeset [30903] by davidb
Vagrant provisioning files for a 4-node Hadoop cluster. See README.txt …

22.10.2016:

19:06 Changeset [30902] by davidb
Details of what packages are needed
16:33 Changeset [30901] by davidb
Template setup file
16:30 Changeset [30900] by davidb
For support Java packages
16:29 Changeset [30899] by davidb
Files for compilation using Eclipse
16:28 Changeset [30898] by davidb
Scripts for downloading sample JSON data from public domain extracted …
16:26 Changeset [30897] by davidb
Sub-project for converted HTRC Extract Feature dataset into a form that …

21.10.2016:

18:18 Changeset [30896] by ak19
Fixing error in commit.
16:59 Changeset [30895] by ak19
Tidier way to set LDFLAGS and not exporting it this time, in case it has …
16:52 Changeset [30894] by ak19
Experimenting to get gnome-lib-minimal sourced at the right time for the …

20.10.2016:

16:15 Changeset [30893] by ak19
Dr Bainbridge made a fix to yaz to get it to compile again: had to replace …
15:47 Changeset [30892] by ak19
Undoing yesterday's commit. Removing libz's dylib files to leave just the …
10:34 Changeset [30891] by kjdon
removed some commented out code. when looking up metadata, if we have an …
09:33 Changeset [30890] by davidb
folder to group together hathitrust related projects
00:20 Changeset [30889] by litvinovg
Fix corrputing html by empty classifier

19.10.2016:

20:46 Changeset [30888] by ak19
Committing ElCap? version of gnome-lib-minimal without the dylib variants …
20:26 Changeset [30887] by ak19
Updating gnome-lib-minimal tar gz for Mountain Lion after recent changes …
19:27 Changeset [30886] by ak19
Corrections to previous commit
18:49 Changeset [30885] by ak19
In order to get the relsase working on Mac ElCapitan?, getting wvware to …
17:06 Changeset [30884] by ak19
Undoing previous commit
16:35 Changeset [30883] by ak19
Experimenting to get libwv to be compiled up correctly on ElCapitan? so it …

18.10.2016:

19:33 Changeset [30882] by ak19
Committing modified gnome-lib-minimal tar gz file for ElCapitan?. If the …
19:28 Changeset [30881] by ak19
Adding in disable-shared and enable-static flags to the configure step in …
17:22 Changeset [30880] by ak19
Some more additions to the new tutorial on incr building.
16:52 Changeset [30879] by ak19
Modifications to get GS2 compiling to work again on Macs after the recent …
16:52 Changeset [30878] by ak19
Modifications to get GS2 compiling to work again on Macs after the recent …

17.10.2016:

19:22 Changeset [30877] by ak19
Dr Bainbridge added an intro and conclusion, and the skeleton of another …
17:01 Changeset [30876] by ak19
Removed the UNUSED folder of unused bins from imagemagick tar file for Mac
15:30 Changeset [30875] by ak19
Renamed the new incr-build sample_files subfolder to incr_build (with …
15:04 Changeset [30874] by ak19
Forgot to commit sample files for new tutorial on cmdline incremental …
14:13 Changeset [30873] by ak19
Making some instructions more explicit.
14:05 Changeset [30872] by ak19
Updated the gnome-lib-minimal.tar.gz for ElCapitan? Mac to incorporate Dr …
11:49 Changeset [30871] by kjdon
need xmlns:gslib in header so that we can use gslib elements in config …
11:48 Changeset [30870] by kjdon
adding xmlns:gslib into the root tags
11:48 Changeset [30869] by kjdon
we need to have xmlns:gslib in the main element
09:54 Changeset [30868] by kjdon
removed a heap of hat-Ms, and modified the gsf:if-metadata-exists template …

14.10.2016:

20:43 Changeset [30867] by ak19
Used a linux machine to run autoconf on the modified configure.in just …
20:41 Changeset [30866] by ak19
GSDLOS variable wasn't being set in configure.in and hence wasn't …
19:45 Changeset [30865] by ak19
Undoing experimental commits 30786-30793
19:33 Changeset [30864] by ak19
Undoing experimental commits 30786-30793
19:02 Changeset [30863] by ak19
Changes to get libiconv issues on MacOS El Capitan straightened out, since …
18:24 Changeset [30862] by ak19
Changes to get libiconv issues on MacOS El Capitan straightened out, since …

13.10.2016:

13:12 Changeset [30861] by kjdon
created a new template named coll-description for easier customization
13:08 Changeset [30860] by kjdon
added in formatTimestamp method to convert a timestamp to human readable …

10.10.2016:

14:48 Changeset [30859] by kjdon
added a template for displaying collection metadata: eg …
14:42 Changeset [30858] by kjdon
output buildDate into the buildConfig.xml (to match builddate in gs2)

07.10.2016:

16:38 Changeset [30857] by ak19
Unless new line endings (particularly carriage return characters missing …

06.10.2016:

18:42 Changeset [30856] by ak19
First commit of the formatted (for tutorials) version of the GS3 tutorial …
17:12 Changeset [30855] by ak19
Dutch translations for the core module of the GS2 interface. Many thanks …
Note: See TracTimeline for information about the timeline view.