root/other-projects/hathitrust/wcsa/extracted-features-solr/trunk/solr-ingest/RUN-PD-MASTER-SPARK.bash @ 31036

Revision 31036, 371 bytes (checked in by davidb, 3 years ago)

Renaming to prepare way for YARN version of script

  • Property svn:executable set to *
Line 
1#!/bin/bash
2
3json_filelist=${1:-pd-file-listing-step10000.txt}
4shift
5
6input_dir="hdfs://master:9000/user/htrc/pd-ef-json-files"
7#input_dir="hdfs://10.10.0.52:9000/user/htrc/pd-ef-json-files"
8
9#output_dir=hdfs://master:9000/user/htrc/pd-solr-json-files
10solr_url="http://10.11.0.53:8983/solr/htrc-pd-ef/update"
11
12master_opt="--master spark://10.10.0.52:7077"
13
14. ./_RUN.bash
Note: See TracBrowser for help on using the browser.