Timeline
2016-11-02:
- 22:52 Changeset [31046] by
- Added property to control how severe a JSON IO problem is
- 21:34 Changeset [31045] by
- More careful treatment of what to do when a JSON file isn't there
- 21:30 Changeset [31044] by
- Fixed up error when output_dir is empty
- 21:24 Changeset [31043] by
- Version for processing full EF set
- 20:18 Changeset [31042] by
- Name changes, preparing the way for FULL-RUN versions
- 20:07 Changeset [31041] by
- Test needs to be more careful if -read-only specified
- 19:53 Changeset [31040] by
- Linking to the correct sample file zip for the cmdline incremental …
- 19:27 Changeset [31039] by
- Minor correction to previous commit.
- 19:25 Changeset [31038] by
- Instructions on format statements in GPS tutorial need to be swapped.
- 17:31 Changeset [31037] by
- Recreating gnome-lib minimal for 32 bit linux in 32 bit lsb environment.
- 17:20 Changeset [31036] by
- Renaming to prepare way for YARN version of script
- 17:16 Changeset [31035] by
- Changes after testing scripts
- 17:10 Changeset [31034] by
- Development of scripts for working with Full EF dataset
- 17:10 Changeset [31033] by
- Development of scripts for working with Full EF dataset
- 16:59 Changeset [31032] by
- Recompiled gnome-lib-minimal in lsb 64 bit environment.
- 15:57 Changeset [31031] by
- Still had to update the linux 32 bit gnome-lib minimal after the …
- 14:28 Changeset [31030] by
- Tweak to some verbosity level 2 printing
- 14:19 Changeset [31029] by
- Newline at end of file added
- 14:17 Changeset [31028] by
- Support for randonly choosing Solr endpoints added in
- 13:06 Changeset [31027] by
- Mixed typo in property name used
- 13:01 Changeset [31026] by
- Corrected flag setting
- 11:59 Changeset [31025] by
- Use property process-json-mode to determine which sort of Spark …
- 11:37 Changeset [31024] by
- Support for Java properties file
2016-11-01:
- 23:46 Changeset [31023] by
- More modifications to hierarchy webeditor
- 14:14 Changeset [31022] by
- No longer used
- 14:14 Changeset [31021] by
- Folder restructure to remove 'trunk' part
- 14:13 Changeset [31020] by
- No longer used
- 14:12 Changeset [31019] by
- Part 2 or two-step folder restructure
- 14:10 Changeset [31018] by
- Part 1 or two-step folder restructure
- 14:08 Changeset [31017] by
- Moved to correct position
- 14:07 Changeset [31016] by
- No longer used
- 14:06 Changeset [31015] by
- Restructuring of projects into one
- 07:42 Changeset [31014] by
- Modified hierarchy js storage, added kjdon fixes.
2016-10-31:
- 20:51 Changeset [31013] by
- Accumulator for PerPageMap
- 18:03 Changeset [31012] by
- Committing 1. new imagemagick tarball created on Gilda El Capitan …
- 15:40 Changeset [31011] by
- Further RDD flatMap/map restructuring and refactoring, for per-page
- 15:14 Changeset [31010] by
- Tidy up on generating Spark App name
- 15:10 Changeset [31009] by
- Adjustments after latest fresh 'vagrant up' trial
- 09:40 Changeset [31008] by
- Additional detail added into Spark app name
- 09:35 Changeset [31007] by
- Class name refactoring
- 09:27 Changeset [31006] by
- Further reversal of Base class. Switch to PerPage
- 09:16 Changeset [31005] by
- Reversal of Base class in PerVolumeJSON
- 00:25 Changeset [31004] by
- added debug
- 00:13 Changeset [31003] by
- Explicity default constructors added
- 00:07 Changeset [31002] by
- Need to separate flatMap and foreach calls in PagedJSON
2016-10-30:
- 23:51 Changeset [31001] by
- Code to work per-volume and per-page
- 22:51 Changeset [31000] by
- Class name refactoring
- 22:50 Changeset [30999] by
- Class name refactoring
- 22:49 Changeset [30998] by
- Class name refactoring
- 22:49 Changeset [30997] by
- Verbosity control over printing
- 22:25 Changeset [30996] by
- Code refactoring
- 21:43 Changeset [30995] by
- Adjustment of NUM_PARTITIONS to be based on Spark recommended calculation
- 17:22 Changeset [30994] by
- Additional useful links. Links open in new tab
- 17:10 Changeset [30993] by
- Placeholder page to provide useful links to hadoop and solr cluster …
- 15:49 Changeset [30992] by
- Additional adjustments after test run on cluster
- 15:41 Changeset [30991] by
- Inital cut at README notes, and supporting links
- 11:39 Changeset [30990] by
- opt name change
- 11:37 Changeset [30989] by
- Changes to better suit EF set used with solr
- 11:32 Changeset [30988] by
- Changed flag to 'read-only' and changed the filed name full text saved …
- 09:35 Changeset [30987] by
- Fixed different size in hierarchy button and li element
2016-10-29:
- 16:57 Changeset [30986] by
- Debugging for double accumulator added
- 16:17 Changeset [30985] by
- Changed to run main processing method as action rather than transform. …
- 15:45 Changeset [30984] by
- Introduction of Spark accumulator to measure progress. Output of POST …
2016-10-28:
- 18:10 Changeset [30983] by
- Useful helper script
- 18:09 Changeset [30982] by
- Fixed to host_name for solr2 and solr3
- 17:53 Changeset [30981] by
- Useful folder for 'on-the-side' packages
- 15:15 Changeset [30980] by
- Code added to read response
- 14:44 Changeset [30979] by
- _solr_url needs to be stored in class!
- 14:40 Changeset [30978] by
- Additional debug statements
- 14:35 Changeset [30977] by
- Only have RDD if an output directory was specified on the command-line …
- 14:32 Changeset [30976] by
- Change to reflect changed order of command-line arguments
- 14:28 Changeset [30975] by
- Introduction of new solr-url command line argument, leading to some …
- 13:47 Changeset [30974] by
- update/add/doc JSON structure needed
- 11:53 Changeset [30973] by
- Changed to saving Solr JSON file for debugging purposes
- 11:46 Changeset [30972] by
- addition of useful command needed before re-running
- 11:35 Changeset [30971] by
- Adding in post to Solr cloud. Changed text_t to _text_
- 11:10 Changeset [30970] by
- Added in mapping of EF-JSON to Solr 'add' JSON format
2016-10-27:
- 23:09 Changeset [30969] by
- Fine tuning resulting from testing the cloud/cluster
- 17:59 Changeset [30968] by
- Correction to regex expression used in sed in z3950 Makefile: what …
- 17:55 Changeset [30967] by
- Correction to regex expression used in sed in z3950 Makefile: what …
- 17:50 Changeset [30966] by
- Adding in lbz2 (lib BZIP2) to the list of libraries in the GNUMakefile …
- 16:44 Changeset [30965] by
- Further clarification
- 16:40 Changeset [30964] by
- Clarification in README
- 16:39 Changeset [30963] by
- Updated gnome-lib-minimal for 64 bit linux after the changes to …
- 16:08 Changeset [30962] by
- Corrections and improvements made after initial testing between …
- 15:51 Changeset [30961] by
- Dr Bainbridge got the new yaz to compile on the Mac Mountain Lion again.
- 14:08 Changeset [30960] by
- Switch to using Puppet to provision machine. Strongly based on files …
- 13:25 Changeset [30959] by
- Made the ConfigEditor modal so that people can't be editing the format …
- 11:43 Changeset [30958] by
- in DocumentMetadataRetrieve, this was creating a paramlist with …
2016-10-26:
- 22:58 Changeset [30957] by
- No longer needed. (Local copy taken on Windows laptop.)
- 22:55 Changeset [30956] by
- Initial commit of files for setting up with Vagrant a Solr cloud
- 18:40 Changeset [30955] by
- New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs …
- 18:39 Changeset [30954] by
- New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs …
- 18:00 Changeset [30953] by
- Need to specify _output_dir as part of output JSON filename
- 18:00 Changeset [30952] by
- Further text tidy up
- 17:54 Changeset [30951] by
- Save a JSONObject as a file in the output directory
- 17:41 Changeset [30950] by
- Tweak to text
- 17:40 Changeset [30949] by
- Use better name than 'foo'. Further fix to JSON name generated
- 17:25 Changeset [30948] by
- Changes in z3950 and recpt Makefile to get dependencies right for …
- 17:24 Changeset [30947] by
- Correction to 'pages-' part of JSON.bz2 output filename used
- 15:47 Changeset [30946] by
- Correction to output JSON.bz2 name generated
- 15:37 Changeset [30945] by
- Getting closer to writing out JSON files
- 14:47 Changeset [30944] by
- Forcer higher partition (6) than default, which seems to be 2
- 14:39 Changeset [30943] by
- Extra debug info
- 14:27 Changeset [30942] by
- Improved output printing for slave node
- 14:16 Changeset [30941] by
- Moved to getFileSystemInstance() method to play nice on cluster
- 14:01 Changeset [30940] by
- Change to using URI not fileIn directly
- 13:57 Changeset [30939] by
- Minor tweaks
- 13:53 Changeset [30938] by
- Experiment with using Hadoop's FileSystem class for local file:// access
- 13:44 Changeset [30937] by
- Expanded set of ClusterFileIO methods
- 11:11 Changeset [30936] by
- Refinement of Spark Monitor echo statements
- 11:09 Changeset [30935] by
- Fixed variable name typo, plus added a couple of 'sleep' pauses of 1 sec
- 11:05 Changeset [30934] by
- Providing json-filelist now a compulsory argument, rather than an option
- 10:24 Changeset [30933] by
- More careful parsing of file prefix
- 10:16 Changeset [30932] by
- Support both file:// and hdfs://
- 09:58 Changeset [30931] by
- Version that runs using fil:// tested
- 09:50 Changeset [30930] by
- Expansion of useful alias commands for Hadoop and Spark
- 09:47 Changeset [30929] by
- Tweaks made while testing the script
- 09:15 Changeset [30928] by
- Forgot to set json_filelist
- 09:12 Changeset [30927] by
- Fixed silly typo in stdout redirect
- 09:09 Changeset [30926] by
- Restructuring of RUN scripts to be more flexible
2016-10-25:
- 23:49 Changeset [30925] by
- Improved instrutions
- 23:49 Changeset [30924] by
- Tidy up of code. Removed commented out code
- 23:28 Changeset [30923] by
- Rough cut version that reads in each JSON file over HDFS
- 23:27 Changeset [30922] by
- Additional rough-cut notes
- 23:23 Changeset [30921] by
- Code change to read in JSON file over HDFS
- 16:46 Changeset [30920] by
- Dr Bainbridge got the z3950 server compiled up again against the …
- 14:52 Changeset [30919] by
- More consistent naming of folders used
- 14:49 Changeset [30918] by
- More flexible command-line args
- 14:20 Changeset [30917] by
- Changes resulting from a fresh run at provisioning, which yielded the …
- 13:44 Changeset [30916] by
- Some additional details -- note form
- 13:32 Changeset [30915] by
- Initial cut at instructions to follow to get code set up and running
- 11:27 Changeset [30914] by
- Tidy up of setup description
- 10:02 Changeset [30913] by
- Renaming to better represent what the cluster is designed for
2016-10-24:
- 15:55 Changeset [30912] by
- Changed to Unix style line-endings
- 15:54 Changeset [30911] by
- Changed name of input directory
- 15:40 Changeset [30910] by
- Additional finesse added in as a result of further testing on Vagrant …
- 15:39 Changeset [30909] by
- Additional finesse added in as a result of further testing on Vagrant …
- 15:39 Changeset [30908] by
- Additional finesse added in as a result of further testing on Vagrant …
2016-10-23:
- 22:08 Changeset [30907] by
- Name change to reflect need for 'bash' not 'sh'
- 22:05 Changeset [30906] by
- Bash version of BAT script
- 18:32 Changeset [30905] by
- Additional resources
- 18:19 Changeset [30904] by
- Extra resource/links added
- 18:11 Changeset [30903] by
- Vagrant provisioning files for a 4-node Hadoop cluster. See …
2016-10-22:
- 19:06 Changeset [30902] by
- Details of what packages are needed
- 16:33 Changeset [30901] by
- Template setup file
- 16:30 Changeset [30900] by
- For support Java packages
- 16:29 Changeset [30899] by
- Files for compilation using Eclipse
- 16:28 Changeset [30898] by
- Scripts for downloading sample JSON data from public domain extracted …
- 16:26 Changeset [30897] by
- Sub-project for converted HTRC Extract Feature dataset into a form …
2016-10-21:
- 18:18 Changeset [30896] by
- Fixing error in commit.
- 16:59 Changeset [30895] by
- Tidier way to set LDFLAGS and not exporting it this time, in case it …
- 16:52 Changeset [30894] by
- Experimenting to get gnome-lib-minimal sourced at the right time for …
2016-10-20:
- 16:15 Changeset [30893] by
- Dr Bainbridge made a fix to yaz to get it to compile again: had to …
- 15:47 Changeset [30892] by
- Undoing yesterday's commit. Removing libz's dylib files to leave just …
- 10:34 Changeset [30891] by
- removed some commented out code. when looking up metadata, if we have …
- 09:33 Changeset [30890] by
- folder to group together hathitrust related projects
- 00:20 Changeset [30889] by
- Fix corrputing html by empty classifier
2016-10-19:
- 20:46 Changeset [30888] by
- Committing ElCap version of gnome-lib-minimal without the dylib …
- 20:26 Changeset [30887] by
- Updating gnome-lib-minimal tar gz for Mountain Lion after recent …
- 19:27 Changeset [30886] by
- Corrections to previous commit
- 18:49 Changeset [30885] by
- In order to get the relsase working on Mac ElCapitan, getting wvware …
- 17:06 Changeset [30884] by
- Undoing previous commit
- 16:35 Changeset [30883] by
- Experimenting to get libwv to be compiled up correctly on ElCapitan so …
2016-10-18:
- 19:33 Changeset [30882] by
- Committing modified gnome-lib-minimal tar gz file for ElCapitan. If …
- 19:28 Changeset [30881] by
- Adding in disable-shared and enable-static flags to the configure step …
- 17:22 Changeset [30880] by
- Some more additions to the new tutorial on incr building.
- 16:52 Changeset [30879] by
- Modifications to get GS2 compiling to work again on Macs after the …
- 16:52 Changeset [30878] by
- Modifications to get GS2 compiling to work again on Macs after the …
2016-10-17:
- 19:22 Changeset [30877] by
- Dr Bainbridge added an intro and conclusion, and the skeleton of …
- 17:01 Changeset [30876] by
- Removed the UNUSED folder of unused bins from imagemagick tar file for Mac
- 15:30 Changeset [30875] by
- Renamed the new incr-build sample_files subfolder to incr_build (with …
- 15:04 Changeset [30874] by
- Forgot to commit sample files for new tutorial on cmdline incremental …
- 14:13 Changeset [30873] by
- Making some instructions more explicit.
- 14:05 Changeset [30872] by
- Updated the gnome-lib-minimal.tar.gz for ElCapitan Mac to incorporate …
- 11:49 Changeset [30871] by
- need xmlns:gslib in header so that we can use gslib elements in config file
- 11:48 Changeset [30870] by
- adding xmlns:gslib into the root tags
- 11:48 Changeset [30869] by
- we need to have xmlns:gslib in the main element
- 09:54 Changeset [30868] by
- removed a heap of hat-Ms, and modified the gsf:if-metadata-exists …
2016-10-14:
- 20:43 Changeset [30867] by
- Used a linux machine to run autoconf on the modified configure.in just …
- 20:41 Changeset [30866] by
- GSDLOS variable wasn't being set in configure.in and hence wasn't …
- 19:45 Changeset [30865] by
- Undoing experimental commits 30786-30793
- 19:33 Changeset [30864] by
- Undoing experimental commits 30786-30793
- 19:02 Changeset [30863] by
- Changes to get libiconv issues on MacOS El Capitan straightened out, …
- 18:24 Changeset [30862] by
- Changes to get libiconv issues on MacOS El Capitan straightened out, …
2016-10-13:
- 13:12 Changeset [30861] by
- created a new template named coll-description for easier customization
- 13:08 Changeset [30860] by
- added in formatTimestamp method to convert a timestamp to human …
2016-10-10:
- 14:48 Changeset [30859] by
- added a template for displaying collection metadata: eg …
- 14:42 Changeset [30858] by
- output buildDate into the buildConfig.xml (to match builddate in gs2)
2016-10-07:
- 16:38 Changeset [30857] by
- Unless new line endings (particularly carriage return characters …
2016-10-06:
- 18:42 Changeset [30856] by
- First commit of the formatted (for tutorials) version of the GS3 …
- 17:12 Changeset [30855] by
- Dutch translations for the core module of the GS2 interface. Many …
Note:
See TracTimeline
for information about the timeline view.