Skip to content

Enable Distributor Plugin Support for Apache Spark OLAC

The Distributor is a utility that is used to distribute JWT and Privacera Tokens from Spark Driver to the Executors. It is only supported for Apache Spark OLAC Deployment using JWT.

To enable Distributor Plugin Support in Apache Spark OLAC, set the OSS_SPARK_PRIVACERA_DISTRIBUTOR_PLUGIN_ENABLE variable to true before running the build_privacera_plugin.sh script.

  1. Navigate to the privacera-oss-plugin plugin directory:

    Bash
    1
    cd ~/privacera-oss-plugin

  2. Open the penv.sh file and update the following properties:

    Bash
    1
2
3
    vi penv.sh

export OSS_SPARK_PRIVACERA_DISTRIBUTOR_PLUGIN_ENABLE=true

  3. After updating the configuration, follow the setup steps starting from the Generate Privacera Deployment File section in the Setup guide to rebuild the image, push it to the registry, and redeploy the Spark environment.