Ignore:
Timestamp:
2019-09-26T22:41:56+12:00 (5 years ago)
Author:
ak19
Message:

Completed sentence that was left hanging.

File:
1 edited

Legend:

Unmodified
Added
Removed

  • gs3-extensions/maori-lang-detection/hdfs-cc-work/Readme.txt

    r33524 r33530  
    177177       --driver-class-path=/home/vagrant/.m2/repository/com/amazonaws/aws-java-sdk/1.7.4/aws-java-sdk-1.7.4.jar:/home/vagrant/.m2/repository/org/apache/hadoop/hadoop-aws/2.7.6/hadoop-aws-2.7.6.jar \
    178178
    179 However the other Spark job in the script does not set --jars or --driver-class-path, despite also referring to the s3a://commoncrawl table. So I'm not sure whether the jars are necessary or whether
     179However the other Spark job in the script does not set --jars or --driver-class-path, despite also referring to the s3a://commoncrawl table. So I'm not sure whether the jars are necessary or whether theywere just being ignored when provided.
    180180
    181181B. Download jar files and put them on the hadoop classpath:
Note: See TracChangeset for help on using the changeset viewer.