source: other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @31300   4 years davidb Need to use NETWORK not PACKAGE
(edit) @31299   4 years davidb Additionally setup MongoDB
(edit) @31298   4 years davidb Initial cut at setup file for MongoDB
(edit) @31297   4 years davidb
(edit) @31275   4 years davidb Changes to allow gc slave nodes to work with local disk versions of …
(edit) @31235   5 years davidb More fine-grained testing to help nema setup
(edit) @31234   5 years davidb More selective control of what to source/setup depending on hostname
(edit) @31233   5 years davidb Changes to operate on nema as well as gsliscluster1 and gc0-9
(edit) @31232   5 years davidb Hand edited version of state.json from gsliscluster1 suitable for …
(edit) @31231   5 years davidb Changes to allow SOLR to run on nodes in /hdfsd05/dbbridge/solr-ef
(edit) @31174   5 years davidb One of the last scripts developed for getting ef dataset into HDFS
(edit) @31173   5 years davidb individual file sizes per top-level folder
(edit) @31172   5 years davidb to help track down missing files in HDFS copy
(edit) @31171   5 years davidb Util to help find where missing files are
(edit) @31170   5 years davidb Targetted sub-dir copy
(edit) @31169   5 years davidb Improved logic
(edit) @31161   5 years davidb Comparison of local disk version with HDFS version
(edit) @31152   5 years davidb Development of script
(edit) @31151   5 years davidb More nuanced version to help finish off the 'big put'
(edit) @31128   5 years davidb Some scripts to help with pushing and monitoring the progress of the …
(edit) @31112   5 years davidb To move out shards saved in /tmp on gsliscluter1 nodes to nema
(edit) @31106   5 years davidb Scripts to help run an rsync'd copy of gslistcluster1 …
(edit) @31105   5 years davidb Additional scripts to help with running solr locally out of /tmp area
(edit) @31104   5 years davidb now configurable to be run from local disk (/tmp)
(edit) @31103   5 years davidb Changes made after testing with 20 solr nodes
(edit) @31101   5 years davidb Correction to collection name
(edit) @31099   5 years davidb Changes resulting from test runs to get Zookeeper and Solr running on …
(edit) @31098   5 years davidb Changes resulting from test runs to get Zookeeper and Solr running on …
(edit) @31097   5 years davidb Changed to .in style namne
(edit) @31082   5 years davidb Changes in response to testing on gchead
(edit) @31081   5 years davidb Going live with generation of spark slaves file
(edit) @31080   5 years davidb echo formatting tidy up. Fixed some typos
(edit) @31079   5 years davidb Useful get started scripts
(add) @31078   5 years davidb Some setup files and scripts to make running Spark and Solr easier on …
Note: See TracRevisionLog for help on using the revision log.