# # ChangeLog for / # # Generated by Trac 1.4.2 # 2024-04-28T12:29:02+12:00 Mon, 07 Nov 2016 10:31:48 GMT davidb [31079] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/GET-PACKAGES-SOLR.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/GET-PACKAGES-SPARK.sh (added) Useful get started scripts Mon, 07 Nov 2016 10:27:52 GMT davidb [31078] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/CONF (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/CONF/htrc_configs.tar.gz (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/CONF/zoo.cfg (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS/remote-solr-start-all.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS/remote-solr-stop-all.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS/remote-spark-start-all.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS/remote-spark-stop-all.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS/remote-zookeeper-start.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS/remote-zookeeper-stop.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SETUP (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SETUP.bash (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SETUP/setup-solr.bash (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SETUP/setup-spark.bash (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SETUP/setup-zookeeper.bash (added) Some setup files and scripts to make running Spark and Solr easier on ... Mon, 07 Nov 2016 09:34:31 GMT davidb [31077] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster/Vagrantfile (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster/manifests/base-hadoop.pp (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster/modules/hadoop/manifests/init.pp (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster/modules/hadoop/templates/hadoop-env.sh (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster/modules/hadoop/templates/hdfs-site.xml (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster/modules/hadoop/templates/masters (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster/modules/hadoop/templates/setup-hadoop.bash (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster/modules/spark/manifests/init.pp (modified) Move up to JDK1.8. Tidy up of Vagrant machine names. Support for ... Mon, 07 Nov 2016 04:42:14 GMT sjm84 [31076] * main/trunk/greenstone2/runtime-src/packages/configure (modified) Getting GS2 yaz client compile in 32 bi tlsb linux environment again ... Mon, 07 Nov 2016 03:38:43 GMT ak19 [31075] * documentation/trunk/tutorial_sample_files/incr_build (moved) Consistent naming of collection sample file directories. Mon, 07 Nov 2016 03:32:55 GMT ak19 [31074] * documentation/trunk/tutorial_sample_files/incr-build/manifests/mod-text-and-meta.xml (moved) * documentation/trunk/tutorial_sample_files/incr-build/manifests/new-metadata.xml (deleted) Renaming some sample files to match latest version of cmdline incr ... Mon, 07 Nov 2016 01:50:34 GMT sjm84 [31073] * main/trunk/greenstone2/runtime-src/packages/configure (modified) Experimenting to fix yaz-client compilation failure on 32 bit linux. Mon, 07 Nov 2016 01:41:53 GMT kjdon [31072] * main/trunk/greenstone3/web/interfaces/default/transform/pages/authen.xsl (modified) added group comment to new user page as well as edit user page. Need ... Mon, 07 Nov 2016 01:37:15 GMT kjdon [31071] * main/trunk/greenstone3/web/WEB-INF/classes/interface_default.properties (modified) strings for the groups description in edit user page Mon, 07 Nov 2016 01:36:23 GMT kjdon [31070] * main/trunk/greenstone3/web/interfaces/default/transform/pages/authen.xsl (modified) added some helpful text about groups Mon, 07 Nov 2016 01:10:34 GMT kjdon [31069] * main/trunk/greenstone3/web/interfaces/default/transform/pages/authen.xsl (modified) added COLLNAME-collection-editor to help users know that this option ... Sun, 06 Nov 2016 22:26:31 GMT kjdon [31068] * main/trunk/greenstone3/web/WEB-INF/classes/interface_default.properties (modified) added top level text string for georgy's hierarchy menu Sun, 06 Nov 2016 22:25:52 GMT kjdon [31067] * main/trunk/greenstone3/web/interfaces/default/js/hierarchy.js (modified) get the 'top level menu' text from the dictionary Sun, 06 Nov 2016 21:26:40 GMT kjdon [31066] * main/trunk/greenstone3/web/interfaces/default/transform/config_format.xsl (modified) collection displayItems are now in a displayItemList Sun, 06 Nov 2016 20:09:03 GMT davidb [31065] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-DOWNLOAD-EVERY-N.sh (modified) Additional echo output Sun, 06 Nov 2016 06:06:32 GMT Georgiy Litvinov [31064] * main/trunk/greenstone3/web/interfaces/default/js/hierarchy.js (modified) Optimized regular expression in hierarchy menu Sat, 05 Nov 2016 14:10:07 GMT Georgiy Litvinov [31063] * main/trunk/greenstone3/web/interfaces/default/js/hierarchy.js (modified) More fixes and imporovements for hierarchy menu Sat, 05 Nov 2016 02:04:01 GMT davidb [31062] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-DOWNLOAD-EVERY-N.sh (modified) Added in -W option so check-sum calculation is skipped Fri, 04 Nov 2016 05:20:07 GMT ak19 [31061] * main/trunk/greenstone3/src/java/org/greenstone/gsdl3/collection/ServiceCluster.java (modified) My previous 'fix' fixed the display for the backdrop collection, but ... Fri, 04 Nov 2016 03:11:13 GMT sjm84 [31060] * main/trunk/greenstone2/runtime-src/src/z3950/Makefile.in (modified) white-space regular expression match wasn't working, so changed it to ... Fri, 04 Nov 2016 02:25:51 GMT sjm84 [31059] * main/trunk/greenstone2/runtime-src/packages/configure (modified) Changed YAZ configure to only produce static library, to help with ... Thu, 03 Nov 2016 22:01:29 GMT davidb [31058] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-DOWNLOAD-EVERY-N.sh (modified) echo for additional information added Thu, 03 Nov 2016 21:59:03 GMT davidb [31057] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/_RUN.sh (modified) Tweak to jps output formatting Thu, 03 Nov 2016 05:42:03 GMT ak19 [31056] * main/trunk/greenstone3/src/java/org/greenstone/gsdl3/collection/ServiceCluster.java (modified) Got the metadata names in the Browse classifier of the backdrop ... Thu, 03 Nov 2016 01:42:19 GMT kjdon [31055] * main/trunk/greenstone3/web/interfaces/default/js/documentmaker_scripts_util.js (modified) newRow is a jquery object which is not the same as the DOM element. ... Thu, 03 Nov 2016 01:42:04 GMT ak19 [31054] * documentation/trunk/tutorial_sample_files/images/image-e/etc/collectionConfig.xml (modified) Non-XML HTML portions of image-e's collectionConfig file now ... Thu, 03 Nov 2016 01:26:13 GMT davidb [31053] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-DOWNLOAD-EVERY-N.sh (modified) Addition of second argument, optional, for where to save the files Thu, 03 Nov 2016 00:53:43 GMT kjdon [31052] * main/trunk/greenstone3/web/interfaces/default/js/documentmaker_scripts_util.js (modified) setting up autocomplete values for metadata editing Thu, 03 Nov 2016 00:46:49 GMT davidb [31051] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/packages/GET-PACKAGES.sh (modified) Added in JDK to list of possible packages needed Thu, 03 Nov 2016 00:41:51 GMT kjdon [31050] * main/trunk/greenstone3/web/interfaces/default/js/document_scripts.js (modified) added empty var and some comments for new autocompletion of meta ... Thu, 03 Nov 2016 00:40:54 GMT kjdon [31049] * main/trunk/greenstone3/web/interfaces/default/transform/pages/document.xsl (modified) add cleaned up metadata name as a class attribute to the ... Thu, 03 Nov 2016 00:25:44 GMT ak19 [31048] * gs3-extensions/solr/trunk/src/collect/solr-jdbm-demo/etc/collectionConfig.xml (modified) Swapping order of displayItems for attribute name=name to get the ... Thu, 03 Nov 2016 00:24:40 GMT ak19 [31047] * main/trunk/greenstone3/web/sites/localsite/collect/lucene-jdbm-demo/etc/collectionConfig.xml (modified) Swapping order of displayItems for attribute name=name to get the ... Wed, 02 Nov 2016 09:52:43 GMT davidb [31046] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/ef-solr.properties (modified) Added property to control how severe a JSON IO problem is Wed, 02 Nov 2016 08:34:47 GMT davidb [31045] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/JSONClusterFileIO.java (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONFlatmap.java (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONMap.java (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) More careful treatment of what to do when a JSON file isn't there Wed, 02 Nov 2016 08:30:49 GMT davidb [31044] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/_RUN.sh (modified) Fixed up error when output_dir is empty Wed, 02 Nov 2016 08:24:32 GMT davidb [31043] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-RUN-MASTER-SPARK.sh (added) Version for processing full EF set Wed, 02 Nov 2016 07:18:22 GMT davidb [31042] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/PD-RUN-MASTER-LOCAL.sh (moved) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/PD-RUN-MASTER-SPARK.sh (moved) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/_RUN.sh (moved) Name changes, preparing the way for FULL-RUN versions Wed, 02 Nov 2016 07:07:40 GMT davidb [31041] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Test needs to be more careful if -read-only specified Wed, 02 Nov 2016 06:53:59 GMT ak19 [31040] * documentation/trunk/tutorials/xml-source/tutorial_en.xml (modified) Linking to the correct sample file zip for the cmdline incremental ... Wed, 02 Nov 2016 06:27:11 GMT ak19 [31039] * documentation/trunk/tutorials/xml-source/tutorial_en.xml (modified) Minor correction to previous commit. Wed, 02 Nov 2016 06:25:06 GMT ak19 [31038] * documentation/trunk/tutorials/xml-source/tutorial_en.xml (modified) Instructions on format statements in GPS tutorial need to be swapped. Wed, 02 Nov 2016 04:31:53 GMT ak19 [31037] * gs2-extensions/gnome-lib/trunk/gnome-lib-minimal-linux.tar.gz (modified) Recreating gnome-lib minimal for 32 bit linux in 32 bit lsb environment. Wed, 02 Nov 2016 04:20:52 GMT davidb [31036] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/RUN-PD-MASTER-LOCAL.bash (moved) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/RUN-PD-MASTER-SPARK.bash (moved) Renaming to prepare way for YARN version of script Wed, 02 Nov 2016 04:16:04 GMT davidb [31035] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-DOWNLOAD-EVERY-N.sh (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-SELECT-EVERY-N.sh (modified) Changes after testing scripts Wed, 02 Nov 2016 04:10:29 GMT davidb [31034] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-DOWNLOAD-EVERY-N.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-GET-FILE-LIST.sh (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/FULL-SELECT-EVERY-N.sh (added) Development of scripts for working with Full EF dataset Wed, 02 Nov 2016 04:10:17 GMT davidb [31033] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/PD-GET-FILE-LIST.sh (moved) Development of scripts for working with Full EF dataset Wed, 02 Nov 2016 03:59:52 GMT sjm84 [31032] * gs2-extensions/gnome-lib/trunk/gnome-lib-minimal-linux-x64.tar.gz (modified) Recompiled gnome-lib-minimal in lsb 64 bit environment. Wed, 02 Nov 2016 02:57:20 GMT ak19 [31031] * gs2-extensions/gnome-lib/trunk/gnome-lib-minimal-linux.tar.gz (modified) Still had to update the linux 32 bit gnome-lib minimal after the ... Wed, 02 Nov 2016 01:28:39 GMT davidb [31030] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONFlatmap.java (modified) Tweak to some verbosity level 2 printing Wed, 02 Nov 2016 01:19:23 GMT davidb [31029] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/ef-solr.properties (modified) Newline at end of file added Wed, 02 Nov 2016 01:17:45 GMT davidb [31028] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/_RUN.bash (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/ef-solr.properties (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONMap.java (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Support for randonly choosing Solr endpoints added in Wed, 02 Nov 2016 00:06:15 GMT davidb [31027] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Mixed typo in property name used Wed, 02 Nov 2016 00:01:16 GMT davidb [31026] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Corrected flag setting Tue, 01 Nov 2016 22:59:37 GMT davidb [31025] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/ef-solr.properties (modified) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Use property process-json-mode to determine which sort of Spark ... Tue, 01 Nov 2016 22:37:07 GMT davidb [31024] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/ef-solr.properties (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Support for Java properties file Tue, 01 Nov 2016 10:46:25 GMT Georgiy Litvinov [31023] * main/trunk/greenstone3/web/interfaces/default/js/hierarchy.js (modified) More modifications to hierarchy webeditor Tue, 01 Nov 2016 01:14:51 GMT davidb [31022] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/web-portal-trunk (deleted) No longer used Tue, 01 Nov 2016 01:14:21 GMT davidb [31021] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/web-portal (copied) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/web-portal-trunk (copied) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/web-portal/trunk (deleted) Folder restructure to remove 'trunk' part Tue, 01 Nov 2016 01:13:11 GMT davidb [31020] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-solr-cluster-trunk (deleted) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster-trunk (deleted) No longer used Tue, 01 Nov 2016 01:12:15 GMT davidb [31019] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-solr-cluster (moved) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster (moved) Part 2 or two-step folder restructure Tue, 01 Nov 2016 01:10:29 GMT davidb [31018] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-solr-cluster-trunk (moved) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster-trunk (moved) Part 1 or two-step folder restructure Tue, 01 Nov 2016 01:08:24 GMT davidb [31017] * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/web-portal (moved) Moved to correct position Tue, 01 Nov 2016 01:07:24 GMT davidb [31016] * other-projects/hathitrust/solr-extracted-features (deleted) No longer used Tue, 01 Nov 2016 01:06:05 GMT davidb [31015] * other-projects/hathitrust/wcsa (added) * other-projects/hathitrust/wcsa/extracted-features-solr (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk (added) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest (moved) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-solr-cluster (moved) * other-projects/hathitrust/wcsa/extracted-features-solr/trunk/vagrant-spark-hdfs-cluster (moved) * other-projects/hathitrust/wcsa/extracted-features-solr/web-portal (moved) Restructuring of projects into one Mon, 31 Oct 2016 18:42:03 GMT Georgiy Litvinov [31014] * main/trunk/greenstone3/web/interfaces/default/js/hierarchy.js (modified) Modified hierarchy js storage, added kjdon fixes. Mon, 31 Oct 2016 07:51:39 GMT davidb [31013] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONMap.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Accumulator for PerPageMap Mon, 31 Oct 2016 05:03:24 GMT ak19 [31012] * gs2-extensions/imagemagick/trunk/README (added) * gs2-extensions/imagemagick/trunk/imagemagick-darwin-10.11.tar.gz (modified) Committing 1. new imagemagick tarball created on Gilda El Capitan ... Mon, 31 Oct 2016 02:40:36 GMT davidb [31011] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONForeach.java (deleted) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONMap.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerVolumeJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/__PerPageJSONForeach.java (added) Further RDD flatMap/map restructuring and refactoring, for per-page Mon, 31 Oct 2016 02:14:07 GMT davidb [31010] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Tidy up on generating Spark App name Mon, 31 Oct 2016 02:10:48 GMT davidb [31009] * other-projects/hathitrust/vagrant-solr-cluster/trunk/README.txt (modified) * other-projects/hathitrust/vagrant-solr-cluster/trunk/modules/solr/manifests/init.pp (modified) * other-projects/hathitrust/vagrant-solr-cluster/trunk/modules/zookeeper/templates/solr-start-all.sh (modified) Adjustments after latest fresh 'vagrant up' trial Sun, 30 Oct 2016 20:40:20 GMT davidb [31008] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Additional detail added into Spark app name Sun, 30 Oct 2016 20:35:06 GMT davidb [31007] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/BasePerJSON.java (deleted) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/JSONSolrTransform.java (deleted) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSON.java (deleted) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSONForeach.java (deleted) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONFlatmap.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerPageJSONForeach.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerVolumeJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/SolrDocJSON.java (added) Class name refactoring Sun, 30 Oct 2016 20:27:42 GMT davidb [31006] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSONForeach.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Further reversal of Base class. Switch to PerPage Sun, 30 Oct 2016 20:16:16 GMT davidb [31005] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerVolumeJSON.java (modified) Reversal of Base class in PerVolumeJSON Sun, 30 Oct 2016 11:25:57 GMT davidb [31004] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) added debug Sun, 30 Oct 2016 11:13:28 GMT davidb [31003] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/BasePerJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSONForeach.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerVolumeJSON.java (modified) Explicity default constructors added Sun, 30 Oct 2016 11:07:39 GMT davidb [31002] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/BasePerJSON.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSONForeach.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerVolumeJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Need to separate flatMap and foreach calls in PagedJSON Sun, 30 Oct 2016 10:51:07 GMT davidb [31001] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/JSONSolrTransform.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PerVolumeJSON.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (modified) Code to work per-volume and per-page Sun, 30 Oct 2016 09:51:02 GMT davidb [31000] * other-projects/hathitrust/solr-extracted-features/trunk/_RUN.bash (modified) Class name refactoring Sun, 30 Oct 2016 09:50:10 GMT davidb [30999] * other-projects/hathitrust/solr-extracted-features/trunk/pom.xml (modified) Class name refactoring Sun, 30 Oct 2016 09:49:56 GMT davidb [30998] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (deleted) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ProcessForSolrIngest.java (added) Class name refactoring Sun, 30 Oct 2016 09:49:39 GMT davidb [30997] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSON.java (modified) Verbosity control over printing Sun, 30 Oct 2016 09:25:42 GMT davidb [30996] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/ClusterFileIO.java (deleted) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PagedJSON.java (deleted) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/ClusterFileIO.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/JSONClusterFileIO.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/JSONSolrTransform.java (added) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/extractedfeatures/PagedJSON.java (added) Code refactoring Sun, 30 Oct 2016 08:43:02 GMT davidb [30995] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (modified) Adjustment of NUM_PARTITIONS to be based on Spark recommended calculation Sun, 30 Oct 2016 04:22:41 GMT davidb [30994] * other-projects/hathitrust/worksets-from-extracted-features/trunk/index.html (modified) Additional useful links. Links open in new tab Sun, 30 Oct 2016 04:10:57 GMT davidb [30993] * other-projects/hathitrust/worksets-from-extracted-features (added) * other-projects/hathitrust/worksets-from-extracted-features/trunk (added) * other-projects/hathitrust/worksets-from-extracted-features/trunk/index.html (added) Placeholder page to provide useful links to hadoop and solr cluster ... Sun, 30 Oct 2016 02:49:35 GMT davidb [30992] * other-projects/hathitrust/vagrant-solr-cluster/trunk/README.txt (modified) Additional adjustments after test run on cluster Sun, 30 Oct 2016 02:41:11 GMT davidb [30991] * other-projects/hathitrust/vagrant-solr-cluster/trunk/NOTES-AND-SOURCES.txt (added) * other-projects/hathitrust/vagrant-solr-cluster/trunk/README.txt (modified) Inital cut at README notes, and supporting links Sat, 29 Oct 2016 22:39:31 GMT davidb [30990] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (modified) opt name change Sat, 29 Oct 2016 22:37:34 GMT davidb [30989] * other-projects/hathitrust/vagrant-solr-cluster/trunk/modules/solr/files (added) * other-projects/hathitrust/vagrant-solr-cluster/trunk/modules/solr/files/htrc_configs.tar.gz (added) * other-projects/hathitrust/vagrant-solr-cluster/trunk/modules/solr/manifests/init.pp (modified) * other-projects/hathitrust/vagrant-solr-cluster/trunk/modules/solr/templates/solr-init-collection.sh (modified) * other-projects/hathitrust/vagrant-solr-cluster/trunk/modules/zookeeper/templates/solr-start-all.sh (modified) Changes to better suit EF set used with solr Sat, 29 Oct 2016 22:32:57 GMT davidb [30988] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PagedJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (modified) Changed flag to 'read-only' and changed the filed name full text ... Sat, 29 Oct 2016 20:35:59 GMT Georgiy Litvinov [30987] * main/trunk/greenstone3/web/interfaces/default/style/core.css (modified) Fixed different size in hierarchy button and li element Sat, 29 Oct 2016 03:57:17 GMT davidb [30986] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (modified) Debugging for double accumulator added Sat, 29 Oct 2016 03:17:22 GMT davidb [30985] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PagedJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (modified) Changed to run main processing method as action rather than ... Sat, 29 Oct 2016 02:45:38 GMT davidb [30984] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PagedJSON.java (modified) * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (modified) Introduction of Spark accumulator to measure progress. Output of ... Fri, 28 Oct 2016 05:10:16 GMT davidb [30983] * other-projects/hathitrust/vagrant-solr-cluster/trunk/packages/GET-PACKAGES.sh (added) Useful helper script Fri, 28 Oct 2016 05:09:40 GMT davidb [30982] * other-projects/hathitrust/vagrant-solr-cluster/trunk/Vagrantfile (modified) Fixed to host_name for solr2 and solr3 Fri, 28 Oct 2016 04:53:41 GMT davidb [30981] * other-projects/hathitrust/vagrant-solr-cluster/trunk/packages (added) Useful folder for 'on-the-side' packages Fri, 28 Oct 2016 02:15:20 GMT davidb [30980] * other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PagedJSON.java (modified) Code added to read response