Skip to content

Setup

This page describes the two supported cluster types for Privacera Encryption Gateway (PEG) with Databricks Unity Catalog and how to set them up.

Single-User Cluster

Single-user cluster encryption uses Java UDFs and a cluster init script. The init script loads the Privacera encryption libraries when the cluster starts.

Aspect Details
UDF Type Java UDF
Init Script Required (from Privacera)
AWS Secrets Manager Not required
Use Case Dedicated compute, single user per cluster

For full setup instructions, see Setup - Single-User Cluster.

Shared Cluster

Shared cluster encryption uses Python UDFs and AWS Secrets Manager to store PEG credentials. No init script is required.

Aspect Details
UDF Type Python UDF
Init Script Not required
AWS Secrets Manager Required
Use Case Multi-user shared compute

For full setup instructions, see Setup - Shared Cluster.

Co-existence

Single-user and shared cluster encryption can co-exist in the same workspace:

  • You can run both Java UDFs (on single-user clusters) and Python UDFs (on shared clusters) in the same Databricks workspace.
  • Each cluster type has its own UDFs, prerequisites, and configuration.
  • Choose the cluster type that fits your use case, or use both for different workloads.