Changeset 30941 for other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java

Timestamp:

2016-10-26T14:16:25+13:00 (8 years ago)

Author:

davidb

Message:

Moved to getFileSystemInstance() method to play nice on cluster

File:

• other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java (modified) (1 diff)

other-projects/hathitrust/solr-extracted-features/trunk/src/main/java/org/hathitrust/PrepareForIngest.java

@@ -36 +36 @@
     {   
         String spark_app_name = "HathiTrust Extract Features: Prepare for Solr Ingest";
-        spark_app_name += "[" + _json_list_filename + "]";
+        spark_app_name += " [" + _json_list_filename + "]";
 
         SparkConf conf = new SparkConf().setAppName(spark_app_name);
         JavaSparkContext jsc = new JavaSparkContext(conf);
-        ClusterFileIO.init(_input_dir);
+        //ClusterFileIO.init(_input_dir);
         
         // Check output directory exists, and create it if not