Timeline


and .

22.11.2016:

19:54 Changeset [31143] by ak19
1. Updates to the tutorial documentation for this release, based on going …
17:24 Changeset [31142] by ak19
Reverting experimental commits 31121 and 31139, as they didn't fix the …
16:59 Changeset [31141] by ak19
Fix to silly error introduced in previous commit. With this fix, have …
15:01 Changeset [31140] by ak19
Experimenting to help update-userdb of the GS3 Mac (El Cap) installer find …
13:21 Ticket #915 (changing ports in gs3-server) created by kjdon
in the server program, File->Settings allows the user to change the tomcat …
13:16 Ticket #914 (solr port issues) created by kjdon
Solr runs off the tomcat port. ext/solr/gs3-setup.sh is run when we source …
13:14 Changeset [31139] by ak19
Wait a max of 15s for derby server to have started up. Experimenting to …
13:05 Changeset [31138] by kjdon
changed the messages a bit to be more helpful
11:24 Changeset [31137] by kjdon
can't use a HashMap? to store two params with the same name. doh. lets just …

21.11.2016:

14:15 Changeset [31136] by ak19
For debugging mac release kit.
14:06 Changeset [31135] by ak19
Added new property file (siteConfig) for Gujarati, so updated svn property …
14:04 Ticket #913 (edit metadata - disallow for internal ones) created by kjdon
In gs3 web editor, *all* metadata is displayed and editable. But the user …
14:03 Changeset [31134] by ak19
Gujarati translations for gs3colcfg module of Greenstone 3's interface. …
13:56 Changeset [31133] by ak19
Trying with a pre-created archives folder for solr-demo collection so that …
13:50 Changeset [31132] by kjdon
added a new flag to import -NO_IMPORT. set it in collectionConfig.xml as …
13:50 Changeset [31131] by kjdon
added a new flag to import -NO_IMPORT. set it in collectionConfig.xml as …
13:44 Changeset [31130] by ak19
French translations for gsinstaller module of GS interface. Many thanks to …
13:44 Changeset [31129] by ak19
Gujarati translations for gs3interface, glidict and GS2 core modules of GS …
13:42 Ticket #912 (Flag arguments to full-rebuild) created by kjdon
Full-rebuild.pl can take import or build specific arguments using the …

20.11.2016:

22:14 Changeset [31128] by davidb
Some scripts to help with pushing and monitoring the progress of the put …

18.11.2016:

15:19 Ticket #911 (Improving Javascript interaction with Java GS3 server) created by ak19
At present, the JS code is polling to find that collection building and …
14:53 Changeset [31127] by ak19
Related to previous revision (31125). Fix to concurrency problem when …
14:28 Changeset [31126] by kjdon
to allow metadata values to contain & and ; when doing online editing, we …
13:32 Changeset [31125] by ak19
Experimental fix for concurrent access issue when using document editor to …

17.11.2016:

17:29 Changeset [31124] by ak19
1. Dr Bainbridge found another oversight in the existing code. 2. Previous …
16:34 Changeset [31123] by ak19
Using the document editor, showed up that multiple metadata …
14:40 Changeset [31122] by kjdon
array.includes is not available in IE, nad only in later firefox etc. so I …
13:44 Changeset [31121] by kjdon
to get online document editing to work, gs3-setup.sh needs to be …
11:58 Changeset [31120] by kjdon
if metavalue is at the end of the list of arguments, and it has a trailing …

16.11.2016:

18:12 Changeset [31119] by ak19
French translations for glihelp module of Greenstone GLI interface. Many …
18:10 Changeset [31118] by ak19
French translations for glidict module of Greenstone interface. Many …
18:07 Changeset [31117] by ak19
French translations for the core module of the GS2 interface. Many thanks …
18:06 Changeset [31116] by ak19
No real changes to language proparties file, just empty spaces and = …
18:03 Changeset [31115] by ak19
Gujarati translations for gs3interface module of GS3. Many thanks to Lavji …
18:03 Changeset [31114] by ak19
French translations for gs3interface module of GS3. Many thanks to Yvan …
17:40 Ticket #910 (PagedImagePlugin - encoding for text item files) created by ak19
A fix was added (revision 31113) for 3.08 that meant text item files that …
17:32 Changeset [31113] by ak19
Text item files now handle UTF-8 properly by reading in the file …
09:24 Changeset [31112] by davidb
To move out shards saved in /tmp on gsliscluter1 nodes to nema

15.11.2016:

20:41 Changeset [31111] by ak19
Same change as for althor interface committed in revision 31110: the home …
19:00 Changeset [31110] by ak19
Fixing the althor interface: home navbar link being shifted down lower …
18:45 Changeset [31109] by ak19
Fixing nullpointer exception thrown when there is no collection groups …
15:27 Changeset [31108] by ak19
French language gs3interface module of Greenstone3. Many thanks to Yvan …

14.11.2016:

21:33 Changeset [31107] by ak19
Fixing subtle and hard to track down mistake that had prevented rebuilding …

11.11.2016:

17:27 Changeset [31106] by davidb
Scripts to help run an rsync'd copy of gslistcluster1 /tmp/gcX-solr-shard …
16:01 Changeset [31105] by davidb
Additional scripts to help with running solr locally out of /tmp area
16:00 Changeset [31104] by davidb
now configurable to be run from local disk (/tmp)
13:22 Changeset [31103] by davidb
Changes made after testing with 20 solr nodes

10.11.2016:

23:15 Changeset [31102] by davidb
Command line way of running a Solr test query
23:08 Changeset [31101] by davidb
Correction to collection name
22:58 Changeset [31100] by davidb
Change to using solr-cloud-nodes that include port number
22:43 Changeset [31099] by davidb
Changes resulting from test runs to get Zookeeper and Solr running on …
22:42 Changeset [31098] by davidb
Changes resulting from test runs to get Zookeeper and Solr running on …
22:41 Changeset [31097] by davidb
Changed to .in style namne
19:25 Changeset [31096] by davidb
Only need to create a volume's pages output directory is _output_dir has …
18:58 Changeset [31095] by davidb
Introduced num-partitions property
16:21 Changeset [31094] by davidb
Changes triggered by running on gsliscluster1
16:20 Changeset [31093] by davidb
Changes triggered by running on gsliscluster1
16:18 Changeset [31092] by davidb
Minor tweak to spark/hadoop combination downloaded
16:15 Changeset [31091] by davidb
Change of number of core for 'gsliscluster1' machine; commmented out …
16:14 Changeset [31090] by davidb
Memory monitor debugging code, commented out
16:13 Changeset [31089] by davidb
Change in way the JSON file is read in. Motivation was a out-of-memory …
16:09 Changeset [31088] by davidb
Shift to newIstance for FileSystem? due to StackOverflow? page describing …

08.11.2016:

18:26 Changeset [31087] by sjm84
Trying once again. This gnome-lib minimal was compiled within a fresh gs2 …
17:16 Changeset [31086] by ak19
Russian language translations for gs3interface module of the Greenstone 3 …
17:16 Changeset [31085] by ak19
Spanish language translations for gs3interface module of the Greenstone 3 …
16:02 Changeset [31084] by sjm84
Some instructions are no longer required, indicating that they're …
16:00 Changeset [31083] by sjm84
Regenerated gnome-lib-minimal on 64 bit linux lsb, with CFLAGS set to …
10:38 Changeset [31082] by davidb
Changes in response to testing on gchead

07.11.2016:

23:51 Changeset [31081] by davidb
Going live with generation of spark slaves file
23:49 Changeset [31080] by davidb
echo formatting tidy up. Fixed some typos
23:31 Changeset [31079] by davidb
Useful get started scripts
23:27 Changeset [31078] by davidb
Some setup files and scripts to make running Spark and Solr easier on the …
22:34 Changeset [31077] by davidb
Move up to JDK1.8. Tidy up of Vagrant machine names. Support for YARN. …
17:42 Changeset [31076] by sjm84
Getting GS2 yaz client compile in 32 bi tlsb linux environment again when …
16:38 Changeset [31075] by ak19
Consistent naming of collection sample file directories.
16:32 Changeset [31074] by ak19
Renaming some sample files to match latest version of cmdline incr …
14:50 Changeset [31073] by sjm84
Experimenting to fix yaz-client compilation failure on 32 bit linux.
14:41 Changeset [31072] by kjdon
added group comment to new user page as well as edit user page. Need to …
14:37 Changeset [31071] by kjdon
strings for the groups description in edit user page
14:36 Changeset [31070] by kjdon
added some helpful text about groups
14:10 Changeset [31069] by kjdon
added COLLNAME-collection-editor to help users know that this option …
11:26 Changeset [31068] by kjdon
added top level text string for georgy's hierarchy menu
11:25 Changeset [31067] by kjdon
get the 'top level menu' text from the dictionary
10:26 Changeset [31066] by kjdon
collection displayItems are now in a displayItemList
09:09 Changeset [31065] by davidb
Additional echo output

06.11.2016:

19:06 Changeset [31064] by litvinovg
Optimized regular expression in hierarchy menu
03:10 Changeset [31063] by litvinovg
More fixes and imporovements for hierarchy menu

05.11.2016:

15:04 Changeset [31062] by davidb
Added in -W option so check-sum calculation is skipped

04.11.2016:

18:20 Changeset [31061] by ak19
My previous 'fix' fixed the display for the backdrop collection, but the …
16:11 Changeset [31060] by sjm84
white-space regular expression match wasn't working, so changed it to a …
15:25 Changeset [31059] by sjm84
Changed YAZ configure to only produce static library, to help with …
11:01 Changeset [31058] by davidb
echo for additional information added
10:59 Changeset [31057] by davidb
Tweak to jps output formatting

03.11.2016:

18:42 Changeset [31056] by ak19
Got the metadata names in the Browse classifier of the backdrop tutorial …
14:42 Changeset [31055] by kjdon
newRow is a jquery object which is not the same as the DOM element. the …
14:42 Changeset [31054] by ak19
Non-XML HTML portions of image-e's collectionConfig file now corrected to …
14:26 Changeset [31053] by davidb
Addition of second argument, optional, for where to save the files
13:53 Changeset [31052] by kjdon
setting up autocomplete values for metadata editing
13:46 Changeset [31051] by davidb
Added in JDK to list of possible packages needed
13:41 Changeset [31050] by kjdon
added empty var and some comments for new autocompletion of meta values …
13:40 Changeset [31049] by kjdon
add cleaned up metadata name as a class attribute to the …
13:25 Changeset [31048] by ak19
Swapping order of displayItems for attribute name=name to get the …
13:24 Changeset [31047] by ak19
Swapping order of displayItems for attribute name=name to get the …

02.11.2016:

22:52 Changeset [31046] by davidb
Added property to control how severe a JSON IO problem is
21:34 Changeset [31045] by davidb
More careful treatment of what to do when a JSON file isn't there
21:30 Changeset [31044] by davidb
Fixed up error when output_dir is empty
21:24 Changeset [31043] by davidb
Version for processing full EF set
20:18 Changeset [31042] by davidb
Name changes, preparing the way for FULL-RUN versions
20:07 Changeset [31041] by davidb
Test needs to be more careful if -read-only specified
19:53 Changeset [31040] by ak19
Linking to the correct sample file zip for the cmdline incremental …
19:27 Changeset [31039] by ak19
Minor correction to previous commit.
19:25 Changeset [31038] by ak19
Instructions on format statements in GPS tutorial need to be swapped.
17:31 Changeset [31037] by ak19
Recreating gnome-lib minimal for 32 bit linux in 32 bit lsb environment.
17:20 Changeset [31036] by davidb
Renaming to prepare way for YARN version of script
17:16 Changeset [31035] by davidb
Changes after testing scripts
17:10 Changeset [31034] by davidb
Development of scripts for working with Full EF dataset
17:10 Changeset [31033] by davidb
Development of scripts for working with Full EF dataset
16:59 Changeset [31032] by sjm84
Recompiled gnome-lib-minimal in lsb 64 bit environment.
15:57 Changeset [31031] by ak19
Still had to update the linux 32 bit gnome-lib minimal after the recent …
14:28 Changeset [31030] by davidb
Tweak to some verbosity level 2 printing
14:19 Changeset [31029] by davidb
Newline at end of file added
14:17 Changeset [31028] by davidb
Support for randonly choosing Solr endpoints added in
13:06 Changeset [31027] by davidb
Mixed typo in property name used
13:01 Changeset [31026] by davidb
Corrected flag setting
11:59 Changeset [31025] by davidb
Use property process-json-mode to determine which sort of Spark mapping to …
11:37 Changeset [31024] by davidb
Support for Java properties file

01.11.2016:

23:46 Changeset [31023] by litvinovg
More modifications to hierarchy webeditor
14:14 Changeset [31022] by davidb
No longer used
14:14 Changeset [31021] by davidb
Folder restructure to remove 'trunk' part
14:13 Changeset [31020] by davidb
No longer used
14:12 Changeset [31019] by davidb
Part 2 or two-step folder restructure
14:10 Changeset [31018] by davidb
Part 1 or two-step folder restructure
14:08 Changeset [31017] by davidb
Moved to correct position
14:07 Changeset [31016] by davidb
No longer used
14:06 Changeset [31015] by davidb
Restructuring of projects into one
07:42 Changeset [31014] by litvinovg
Modified hierarchy js storage, added kjdon fixes.

31.10.2016:

20:51 Changeset [31013] by davidb
Accumulator for PerPageMap?
18:03 Changeset [31012] by ak19
Committing 1. new imagemagick tarball created on Gilda El Capitan (since …
15:40 Changeset [31011] by davidb
Further RDD flatMap/map restructuring and refactoring, for per-page
15:14 Changeset [31010] by davidb
Tidy up on generating Spark App name
15:10 Changeset [31009] by davidb
Adjustments after latest fresh 'vagrant up' trial
09:40 Changeset [31008] by davidb
Additional detail added into Spark app name
09:35 Changeset [31007] by davidb
Class name refactoring
09:27 Changeset [31006] by davidb
Further reversal of Base class. Switch to PerPage?
09:16 Changeset [31005] by davidb
Reversal of Base class in PerVolumeJSON
00:25 Changeset [31004] by davidb
added debug
00:13 Changeset [31003] by davidb
Explicity default constructors added
00:07 Changeset [31002] by davidb
Need to separate flatMap and foreach calls in PagedJSON

30.10.2016:

23:51 Changeset [31001] by davidb
Code to work per-volume and per-page
22:51 Changeset [31000] by davidb
Class name refactoring
22:50 Changeset [30999] by davidb
Class name refactoring
22:49 Changeset [30998] by davidb
Class name refactoring
22:49 Changeset [30997] by davidb
Verbosity control over printing
22:25 Changeset [30996] by davidb
Code refactoring
21:43 Changeset [30995] by davidb
Adjustment of NUM_PARTITIONS to be based on Spark recommended calculation
17:22 Changeset [30994] by davidb
Additional useful links. Links open in new tab
17:10 Changeset [30993] by davidb
Placeholder page to provide useful links to hadoop and solr cluster …
15:49 Changeset [30992] by davidb
Additional adjustments after test run on cluster
15:41 Changeset [30991] by davidb
Inital cut at README notes, and supporting links
11:39 Changeset [30990] by davidb
opt name change
11:37 Changeset [30989] by davidb
Changes to better suit EF set used with solr
11:32 Changeset [30988] by davidb
Changed flag to 'read-only' and changed the filed name full text saved …
09:35 Changeset [30987] by litvinovg
Fixed different size in hierarchy button and li element

29.10.2016:

16:57 Changeset [30986] by davidb
Debugging for double accumulator added
16:17 Changeset [30985] by davidb
Changed to run main processing method as action rather than transform. …
15:45 Changeset [30984] by davidb
Introduction of Spark accumulator to measure progress. Output of POST …

28.10.2016:

18:10 Changeset [30983] by davidb
Useful helper script
18:09 Changeset [30982] by davidb
Fixed to host_name for solr2 and solr3
17:53 Changeset [30981] by davidb
Useful folder for 'on-the-side' packages
15:15 Changeset [30980] by davidb
Code added to read response
14:44 Changeset [30979] by davidb
_solr_url needs to be stored in class!
14:40 Changeset [30978] by davidb
Additional debug statements
14:35 Changeset [30977] by davidb
Only have RDD if an output directory was specified on the command-line …
14:32 Changeset [30976] by davidb
Change to reflect changed order of command-line arguments
14:28 Changeset [30975] by davidb
Introduction of new solr-url command line argument, leading to some other …
13:47 Changeset [30974] by davidb
update/add/doc JSON structure needed
11:53 Changeset [30973] by davidb
Changed to saving Solr JSON file for debugging purposes
11:46 Changeset [30972] by davidb
addition of useful command needed before re-running
11:35 Changeset [30971] by davidb
Adding in post to Solr cloud. Changed text_t to _text_
11:10 Changeset [30970] by davidb
Added in mapping of EF-JSON to Solr 'add' JSON format

27.10.2016:

23:09 Changeset [30969] by davidb
Fine tuning resulting from testing the cloud/cluster
17:59 Changeset [30968] by ak19
Correction to regex expression used in sed in z3950 Makefile: what worked …
17:55 Changeset [30967] by ak19
Correction to regex expression used in sed in z3950 Makefile: what worked …
17:50 Changeset [30966] by ak19
Adding in lbz2 (lib BZIP2) to the list of libraries in the GNUMakefile …
16:44 Changeset [30965] by ak19
Further clarification
16:40 Changeset [30964] by ak19
Clarification in README
16:39 Changeset [30963] by ak19
Updated gnome-lib-minimal for 64 bit linux after the changes to compile up …
16:08 Changeset [30962] by davidb
Corrections and improvements made after initial testing between zookeeper …
15:51 Changeset [30961] by ak19
Dr Bainbridge got the new yaz to compile on the Mac Mountain Lion again.
14:08 Changeset [30960] by davidb
Switch to using Puppet to provision machine. Strongly based on files …
13:25 Changeset [30959] by kjdon
Made the ConfigEditor? modal so that people can't be editing the format …
11:43 Changeset [30958] by kjdon
in DocumentMetadataRetrieve?, this was creating a paramlist with …

26.10.2016:

22:58 Changeset [30957] by davidb
No longer needed. (Local copy taken on Windows laptop.)
22:55 Changeset [30956] by davidb
Initial commit of files for setting up with Vagrant a Solr cloud
18:40 Changeset [30955] by ak19
New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs after …
18:39 Changeset [30954] by ak19
New yaz 2.1.56 was needed to get GS2 compiling to work again on Macs after …
18:00 Changeset [30953] by davidb
Need to specify _output_dir as part of output JSON filename
18:00 Changeset [30952] by davidb
Further text tidy up
17:54 Changeset [30951] by davidb
Save a JSONObject as a file in the output directory
17:41 Changeset [30950] by davidb
Tweak to text
17:40 Changeset [30949] by davidb
Use better name than 'foo'. Further fix to JSON name generated
17:25 Changeset [30948] by ak19
Changes in z3950 and recpt Makefile to get dependencies right for libyaz …
17:24 Changeset [30947] by davidb
Correction to 'pages-' part of JSON.bz2 output filename used
15:47 Changeset [30946] by davidb
Correction to output JSON.bz2 name generated
15:37 Changeset [30945] by davidb
Getting closer to writing out JSON files
14:47 Changeset [30944] by davidb
Forcer higher partition (6) than default, which seems to be 2
14:39 Changeset [30943] by davidb
Extra debug info
14:27 Changeset [30942] by davidb
Improved output printing for slave node
14:16 Changeset [30941] by davidb
Moved to getFileSystemInstance() method to play nice on cluster
14:01 Changeset [30940] by davidb
Change to using URI not fileIn directly
13:57 Changeset [30939] by davidb
Minor tweaks
13:53 Changeset [30938] by davidb
Experiment with using Hadoop's FileSystem? class for local  file:// access
13:44 Changeset [30937] by davidb
Expanded set of ClusterFileIO methods
11:11 Changeset [30936] by davidb
Refinement of Spark Monitor echo statements
11:09 Changeset [30935] by davidb
Fixed variable name typo, plus added a couple of 'sleep' pauses of 1 sec
11:05 Changeset [30934] by davidb
Providing json-filelist now a compulsory argument, rather than an option
10:24 Changeset [30933] by davidb
More careful parsing of file prefix
10:16 Changeset [30932] by davidb
Support both  file:// and  hdfs://
09:58 Changeset [30931] by davidb
Version that runs using  fil:// tested
09:50 Changeset [30930] by davidb
Expansion of useful alias commands for Hadoop and Spark
09:47 Changeset [30929] by davidb
Tweaks made while testing the script
09:15 Changeset [30928] by davidb
Forgot to set json_filelist
09:12 Changeset [30927] by davidb
Fixed silly typo in stdout redirect
09:09 Changeset [30926] by davidb
Restructuring of RUN scripts to be more flexible

25.10.2016:

23:49 Changeset [30925] by davidb
Improved instrutions
23:49 Changeset [30924] by davidb
Tidy up of code. Removed commented out code
23:28 Changeset [30923] by davidb
Rough cut version that reads in each JSON file over HDFS
23:27 Changeset [30922] by davidb
Additional rough-cut notes
23:23 Changeset [30921] by davidb
Code change to read in JSON file over HDFS
16:46 Changeset [30920] by ak19
Dr Bainbridge got the z3950 server compiled up again against the recent …
14:52 Changeset [30919] by davidb
More consistent naming of folders used
14:49 Changeset [30918] by davidb
More flexible command-line args
14:20 Changeset [30917] by davidb
Changes resulting from a fresh run at provisioning, which yielded the …
13:44 Changeset [30916] by davidb
Some additional details -- note form
13:32 Changeset [30915] by davidb
Initial cut at instructions to follow to get code set up and running
11:27 Changeset [30914] by davidb
Tidy up of setup description
10:02 Changeset [30913] by davidb
Renaming to better represent what the cluster is designed for

24.10.2016:

15:55 Changeset [30912] by davidb
Changed to Unix style line-endings
15:54 Changeset [30911] by davidb
Changed name of input directory
15:40 Changeset [30910] by davidb
Additional finesse added in as a result of further testing on Vagrant …
15:39 Changeset [30909] by davidb
Additional finesse added in as a result of further testing on Vagrant …
15:39 Changeset [30908] by davidb
Additional finesse added in as a result of further testing on Vagrant …

23.10.2016:

22:08 Changeset [30907] by davidb
Name change to reflect need for 'bash' not 'sh'
22:05 Changeset [30906] by davidb
Bash version of BAT script
18:32 Changeset [30905] by davidb
Additional resources
18:19 Changeset [30904] by davidb
Extra resource/links added
18:11 Changeset [30903] by davidb
Vagrant provisioning files for a 4-node Hadoop cluster. See README.txt …
Note: See TracTimeline for information about the timeline view.