Changeset 33499

Timestamp:

2019-09-23T17:59:07+12:00 (5 years ago)

Author:

ak19

Message:

Explicitly adding in IAM policy configuration details instead of just linking to the page containing these details, so that if the page expires, we still have the information.

File:

• gs3-extensions/maori-lang-detection/MoreReading/Vagrant-Spark-Hadoop.txt (modified) (1 diff)

gs3-extensions/maori-lang-detection/MoreReading/Vagrant-Spark-Hadoop.txt

@@ -514 +514 @@
 commoncrawl profile created while creating the user/role, by following the instructions at: https://answers.dataiku.com/1734/common-crawl-s3
 
+https://answers.dataiku.com/1734/common-crawl-s3
+Even though the bucket is public, if your AWS key does not have your full permissions (ie if it's a restricted IAM user), you need to grant explicit access to the commoncrawl bucket: attach the following policy to your IAM user:
+#### START JSON (POLICY) ###
+{
+    "Version": "2012-10-17",
+    "Statement": [
+        {
+            "Sid": "Stmt1503647467000",
+            "Effect": "Allow",
+            "Action": [
+                "s3:GetObject",
+                "s3:ListBucket"
+            ],
+            "Resource": [
+                "arn:aws:s3:::commoncrawl/*",
+                "arn:aws:s3:::commoncrawl"
+            ]
+        }
+    ]
+}
+#### END ###
+
 <!--
     <property>