root/other-projects/hathitrust/solr-extracted-features/trunk/RUN.bat @ 30898

Revision 30898, 0.6 KB (checked in by davidb, 3 years ago)

Scripts for downloading sample JSON data from public domain extracted feature set, and some initial processing using Apache Spark

  • Property svn:executable set to *
Line 
1
2::spark-submit --class SimpleApp --master local[2] target\htrc-ef-ingest-0.9.jar %1 %2 %3 %4
3
4::spark-submit --class PrepareForIngest --master local[2] target\htrc-ef-ingest-0.9.jar %1 %2 %3 %4
5
6
7spark-submit --class org.hathitrust.PrepareForIngest --master local[4] target\htrc-ef-ingest-0.9-jar-with-dependencies.jar --json-filelist=quick-test.txt json-files solr-files %1 %2 %3 %4
8
9:: spark-submit --class org.hathitrust.PrepareForIngest --master local[4] target\htrc-ef-ingest-0.9-jar-with-dependencies.jar --json-filelist=pd-file-listing-step1000.txt json-files solr-files %1 %2 %3 %4
Note: See TracBrowser for help on using the browser.