|
Last change
on this file since 30908 was 30898, checked in by davidb, 7 years ago |
|
Scripts for downloading sample JSON data from public domain extracted feature set, and some initial processing using Apache Spark
|
-
Property svn:executable
set to
*
|
|
File size:
600 bytes
|
| Line | |
|---|
| 1 |
|
|---|
| 2 | ::spark-submit --class SimpleApp --master local[2] target\htrc-ef-ingest-0.9.jar %1 %2 %3 %4
|
|---|
| 3 |
|
|---|
| 4 | ::spark-submit --class PrepareForIngest --master local[2] target\htrc-ef-ingest-0.9.jar %1 %2 %3 %4
|
|---|
| 5 |
|
|---|
| 6 |
|
|---|
| 7 | spark-submit --class org.hathitrust.PrepareForIngest --master local[4] target\htrc-ef-ingest-0.9-jar-with-dependencies.jar --json-filelist=quick-test.txt json-files solr-files %1 %2 %3 %4
|
|---|
| 8 |
|
|---|
| 9 | :: spark-submit --class org.hathitrust.PrepareForIngest --master local[4] target\htrc-ef-ingest-0.9-jar-with-dependencies.jar --json-filelist=pd-file-listing-step1000.txt json-files solr-files %1 %2 %3 %4
|
|---|
Note:
See
TracBrowser
for help on using the repository browser.
