Skip to content

Deny unsupported SQL primitives by default on Databricks FGAC

Overview

Use this configuration to enable the deny-by-default mechanism for unsupported SQL primitives in Databricks FGAC Spark queries.

Configure

  1. SSH to the instance where Privacera Manager is installed.

  2. Run the following command to navigate to the custom-vars directory:

    Bash
    1
    cd ~/privacera/privacera-manager/config/custom-vars

  3. Edit the vars.databricks.plugin.yml file:

    Bash
    1
    vi vars.databricks.plugin.yml

  4. Uncomment and set the following property:

    YAML
    1
    DATABRICKS_SPARK_DENY_UNSUPPORTED_SQL_PRIMITIVES_ENABLED: "true"

    Note

    • Set to "true" to enable the deny-by-default mechanism for unsupported SQL primitives.
    • Set to "false" (default) to retain legacy behavior.

  5. Once the property is configured, run the following command to generate the plugin configurations:

    Bash
    1
2
    cd ~/privacera/privacera-manager
./privacera-manager.sh post-install

  6. Click Start or, if the cluster is running, click Confirm and Restart.

  1. Go to the Databricks cluster.

  2. Click the Edit button in the cluster.

  3. Under Advanced options, go to the Spark tab.

  4. In the Spark config section, add the following property:

    Bash
    1
    spark.hadoop.privacera.spark.deny.unsupported.sql.primitives.enabled true

    Note

    • Set to true to enable the deny-by-default mechanism for unsupported SQL primitives.
    • Set to false (default) to retain legacy behavior.

  5. Click Confirm to save the changes.

  6. Click Restart to restart the cluster.