Changeset 27487

Show
Ignore:
Timestamp:
28.05.2013 09:33:33 (6 years ago)
Author:
jmt12
Message:

Ensure Parallel Building path in environment (for ThriftFS) and that the appropriate protocol is written to the manifests (HDThriftFS or HDFSShell)

Files:
1 modified

Legend:

Unmodified
Added
Removed
  • gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java

    r27433 r27487  
    183183      fw1.write("[Host:" + InetAddress.getLocalHost().getHostName() + "]\n"); 
    184184      fw1.write("[Task:" + task_id + "]\n"); 
     185 
     186      // Programatically rewrite the protocol as appropriate for the given 
     187      // archives directory 
     188      file_path = file_path.replace("hdfs://", hdfs_prefix); 
    185189      fw1.write("[Map:" + file_path + " => " + value + "]\n"); 
    186190 
     
    223227      import_process_env.put("GSDLEXTS", "parallel-building:tdb-edit:video-and-audio"); 
    224228      //   - installed extension paths 
     229      import_process_env.put("GEXTPARALLELBUILDING", gsdlhome + "/ext/parallel-building"); 
    225230      import_process_env.put("GEXTPARALLELBUILDING_INSTALLED", gsdlhome + "/ext/parallel-building/linux"); 
     231      import_process_env.put("GEXTTDBEDIT_INSTALLED", gsdlhome + "/ext/tdb-edit/linux"); 
    226232      import_process_env.put("GEXTVIDEO_INSTALLED", gsdlhome + "/ext/video-and-audio/linux"); 
    227       import_process_env.put("GEXTTDBEDIT_INSTALLED", gsdlhome + "/ext/tdb-edit/linux"); 
    228233      // - Hadoop specific 
    229234      import_process_env.put("HADOOP_PREFIX", hadoop_prefix);