Changeset 33499

Show
Ignore:
Timestamp:
23.09.2019 17:59:07 (3 weeks ago)
Author:
ak19
Message:

Explicitly adding in IAM policy configuration details instead of just linking to the page containing these details, so that if the page expires, we still have the information.

Files:
1 modified

Legend:

Unmodified
Added
Removed
  • gs3-extensions/maori-lang-detection/MoreReading/Vagrant-Spark-Hadoop.txt

    r33496 r33499  
    514514commoncrawl profile created while creating the user/role, by following the instructions at: https://answers.dataiku.com/1734/common-crawl-s3 
    515515 
     516https://answers.dataiku.com/1734/common-crawl-s3 
     517Even though the bucket is public, if your AWS key does not have your full permissions (ie if it's a restricted IAM user), you need to grant explicit access to the commoncrawl bucket: attach the following policy to your IAM user: 
     518#### START JSON (POLICY) ### 
     519{ 
     520    "Version": "2012-10-17", 
     521    "Statement": [ 
     522        { 
     523            "Sid": "Stmt1503647467000", 
     524            "Effect": "Allow", 
     525            "Action": [ 
     526                "s3:GetObject", 
     527                "s3:ListBucket" 
     528            ], 
     529            "Resource": [ 
     530                "arn:aws:s3:::commoncrawl/*", 
     531                "arn:aws:s3:::commoncrawl" 
     532            ] 
     533        } 
     534    ] 
     535} 
     536#### END ### 
     537 
    516538<!-- 
    517539    <property>