Skip to content

Privacera Plugin in Dataproc

This section covers how you can use Privacera Manager to generate the setup script and Dataproc custom configuration to install Privacera Plugin in the GCP Dataproc environment.


Ensure the following prerequisites are met:

  • A working Dataproc environment.

  • Privacera services must be up and running.


  1. SSH to the instance where Privacera is installed.

  2. Run the following command:

    cd ~/privacera/privacera-manager
    cp config/sample-vars/vars.dataproc.yml config/custom-vars/
    vi config/custom-vars/vars.dataproc.yml
  3. Edit the following properties:

    Property Description Example
    DATAPROC_ENABLE Enable Dataproc template creation. true

    Set this property to upload the init script to GCP Cloud Storage.

    If the value is set to true, then Privacera will upload the init script to the GCP bucket.

    If the value is set to false, then manually upload the init script to a GCP bucket.

    DATAPROC_PRIVACERA_GS_BUCKET Enter the GCP bucket name where the init script will be uploaded. gs://privacera-bucket

    Use the property to enable/disable the fallback behavior to the privacera_files and privacera_hive services. It confirms whether the resources files should be allowed/denied access to the user.

    To enable the fallback, set to true; to disable, set to false.


  4. Run the update.

    cd ~/privacera/privacera-manager
    ./ update

    After the update is complete, the setup script and Dataproc custom configurations will be generated at the path, ~/privacera/privacera-manager/output/dataproc.

  5. If DATAPROC_MANAGE_INIT_SCRIPT is set to false, then copy and Both the files should be placed under the same folder.

    cd ~/privacera/privacera-manager/output/dataproc
    gsutil cp gs://${GS_BUCKET}/privacera/dataproc/init/
    gsutil cp gs://${GS_BUCKET}/privacera/dataproc/init/
  6. SSH to the instance where the master node of the Dataproc is installed. Then, enter the GCP bucket name and run the setup script.

    sudo su - 
    mkdir -p /opt/privacera/downloads
    cd /opt/privacera/downloads
    gsutil cp gs://${GS_BUCKET}/privacera/dataproc/init/ .
    chmod +x