Changeset 33530

Show
Ignore:
Timestamp:
26.09.2019 22:41:56 (3 weeks ago)
Author:
ak19
Message:

Completed sentence that was left hanging.

Files:
1 modified

Legend:

Unmodified
Added
Removed
  • gs3-extensions/maori-lang-detection/hdfs-cc-work/Readme.txt

    r33524 r33530  
    177177       --driver-class-path=/home/vagrant/.m2/repository/com/amazonaws/aws-java-sdk/1.7.4/aws-java-sdk-1.7.4.jar:/home/vagrant/.m2/repository/org/apache/hadoop/hadoop-aws/2.7.6/hadoop-aws-2.7.6.jar \ 
    178178 
    179 However the other Spark job in the script does not set --jars or --driver-class-path, despite also referring to the s3a://commoncrawl table. So I'm not sure whether the jars are necessary or whether  
     179However the other Spark job in the script does not set --jars or --driver-class-path, despite also referring to the s3a://commoncrawl table. So I'm not sure whether the jars are necessary or whether theywere just being ignored when provided. 
    180180 
    181181B. Download jar files and put them on the hadoop classpath: