Skip to content

Enable Access to Requester Pays Buckets in EMR

If you are using Requester Pays buckets in Amazon S3, you need to enable access to these buckets in Amazon EMR. You can enable access to Requester Pays buckets in Amazon EMR by setting the fs.s3a.requester-pays.enabled property to true.

Prerequisites

Make you have configured Privacera DataServer to support Requester Pays buckets. For more information, see Configuring Privacera DataServer to Support Requester Pays Buckets.

Setup

To enable access to Requester Pays buckets, include the following property in EMR cluster's Spark configuration:

JSON
1
2
3
4
5
6
{
  "Classification": "spark-defaults",
  "Properties": {
    "spark.hadoop.fs.s3a.requester-pays.enabled": "true"
  }
}

Comments