Skip to content

Enable S3 Table in Apache Spark OLAC

To enable S3 Table support in Apache Spark OLAC, set the OSS_S3_TABLE_ENABLE variable to true before executing the build_privacera_plugin.sh script.

  1. Navigate to the privacera-oss-plugin plugin directory:

    Bash
    1
    cd ~/privacera-oss-plugin

  2. Open the penv.sh file and update the following properties:

    Bash
    1
2
3
4
5
6
    vi penv.sh

# Uncomment this to enable s3 table support
OSS_S3_TABLE_ENABLE=true
# Set S3 Table warehouse path
S3_TABLE_WAREHOUSE="arn:aws:s3tables:<region>:<account-id>:bucket/<bucket-name>"

  3. After updating the configuration, follow the setup steps starting from the Generate Privacera Deployment File section in the Setup guide to rebuild the image, push it to the registry, and redeploy the Spark environment.

  4. For information on how to use and validate S3 Table in Apache Spark, see the Using S3 Table with Apache Spark OLAC guide.