Show
Ignore:
Timestamp:
05.01.2017 23:44:10 (3 years ago)
Author:
davidb
Message:

Changes to allow gc slave nodes to work with local disk versions of packages like Spark, so it can then use the bigger area /hdfsd05/dbbridge/tmp as the area of RDD spill

Files:
1 modified

Legend:

Unmodified
Added
Removed
  • other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SETUP.bash

    r31234 r31275  
    2121fi 
    2222 
    23 export HTRC_EF_PACKAGE_HOME=`pwd` 
     23if [ "${short_hostname%[0-9]}" = "gc" ] ; then 
     24  export HTRC_EF_PACKAGE_HOME="/hdfsd05/dbbridge/gslis-cluster" 
     25else 
     26  export HTRC_EF_PACKAGE_HOME=`pwd` 
     27fi 
     28 
     29HTRC_EF_NETWORK_HOME=`pwd` 
    2430 
    2531if [ "$short_hostname" = "gsliscluster1" ] ; then 
     
    2834fi 
    2935 
    30 export JAVA_HOME="$HTRC_EF_PACKAGE_HOME/jdk1.8.0" 
     36export JAVA_HOME="$HTRC_EF_NETWORK_HOME/jdk1.8.0" 
    3137export PATH="$JAVA_HOME/bin:$PATH" 
    3238#export _JAVA_OPTIONS="-Xmx512m" 
     
    4854 
    4955 
    50 export PATH="$HTRC_EF_PACKAGE_HOME/SCRIPTS:$PATH" 
     56export PATH="$HTRC_EF_NETWORK_HOME/SCRIPTS:$PATH" 
    5157if [ "$short_hostname" = "gsliscluster1" ] ; then 
    5258  echo "* Added in HTRC EF PACKAGE remote scripting into PATH"