source: other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/PD-RUN-MASTER-SPARK.sh@ 31042

Last change on this file since 31042 was 31042, checked in by davidb, 7 years ago

Name changes, preparing the way for FULL-RUN versions

  • Property svn:executable set to *
File size: 376 bytes
RevLine 
[30926]1#!/bin/bash
2
[30928]3json_filelist=${1:-pd-file-listing-step10000.txt}
[30929]4shift
[30928]5
[30926]6input_dir="hdfs://master:9000/user/htrc/pd-ef-json-files"
7#input_dir="hdfs://10.10.0.52:9000/user/htrc/pd-ef-json-files"
8
[30975]9#output_dir=hdfs://master:9000/user/htrc/pd-solr-json-files
10solr_url="http://10.11.0.53:8983/solr/htrc-pd-ef/update"
[30926]11
12master_opt="--master spark://10.10.0.52:7077"
13
[31042]14. scripts/_RUN.sh
15
Note: See TracBrowser for help on using the repository browser.