|
Last change
on this file since 31036 was 31036, checked in by davidb, 7 years ago |
|
Renaming to prepare way for YARN version of script
|
-
Property svn:executable
set to
*
|
|
File size:
371 bytes
|
| Line | |
|---|
| 1 | #!/bin/bash
|
|---|
| 2 |
|
|---|
| 3 | json_filelist=${1:-pd-file-listing-step10000.txt}
|
|---|
| 4 | shift
|
|---|
| 5 |
|
|---|
| 6 | input_dir="hdfs://master:9000/user/htrc/pd-ef-json-files"
|
|---|
| 7 | #input_dir="hdfs://10.10.0.52:9000/user/htrc/pd-ef-json-files"
|
|---|
| 8 |
|
|---|
| 9 | #output_dir=hdfs://master:9000/user/htrc/pd-solr-json-files
|
|---|
| 10 | solr_url="http://10.11.0.53:8983/solr/htrc-pd-ef/update"
|
|---|
| 11 |
|
|---|
| 12 | master_opt="--master spark://10.10.0.52:7077"
|
|---|
| 13 |
|
|---|
| 14 | . ./_RUN.bash
|
|---|
Note:
See
TracBrowser
for help on using the repository browser.
