root/other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/scripts/PD-RUN-MASTER-SPARK.sh @ 31042

Revision 31042, 376 bytes (checked in by davidb, 3 years ago)

Name changes, preparing the way for FULL-RUN versions

  • Property svn:executable set to *
Line 
1#!/bin/bash
2
3json_filelist=${1:-pd-file-listing-step10000.txt}
4shift
5
6input_dir="hdfs://master:9000/user/htrc/pd-ef-json-files"
7#input_dir="hdfs://10.10.0.52:9000/user/htrc/pd-ef-json-files"
8
9#output_dir=hdfs://master:9000/user/htrc/pd-solr-json-files
10solr_url="http://10.11.0.53:8983/solr/htrc-pd-ef/update"
11
12master_opt="--master spark://10.10.0.52:7077"
13
14. scripts/_RUN.sh
15
Note: See TracBrowser for help on using the browser.