Skip to content

Deny unsupported SQL primitives by default on EMR

Overview

Use this configuration to enable the deny-by-default mechanism for unsupported SQL primitives in EMR Spark queries.

Configure

  1. SSH to the instance where Privacera is installed.
  2. Run the following command to navigate to the /custom-vars directory.
    Bash
    1
    cd ~/privacera/privacera-manager/config/custom-vars
  3. Edit the vars.emr.yml file
    Bash
    1
    vi vars.emr.yml
  4. Uncomment the below-mentioned flag to set its value to true.
    Bash
    1
    EMR_SPARK_DENY_UNSUPPORTED_SQL_PRIMITIVES_ENABLED: "true"
  5. Once the properties are updated, run below command to generate the plugin configurations:
    Bash
    1
2
    cd ~/privacera/privacera-manager
./privacera-manager.sh post-install
  6. Follow the steps given here to deploy the EMR Cluster with changes.