Skip to main content

Privacera Documentation

Spark

Spark SQL use case:

  1. SSH to EMR master node.

  2. kinit with your user.

  3. Run Spark-SQL shell using “spark-sql”.

  4. Run SQL type queries with Spark.

Policies are evaluated against the “privacera_hive” repository and audits can be seen under Access Manager > Audits.

Spark Shell use case:

  1. SSH to EMR master node.

  2. kinit with your user.

  3. Run Spark-shell using “spark-shell”.

  4. Run Scala queries with Spark.

Policies are evaluated against the privacera_emrfs_s3 policy repository for any S3 access. Audits can be seen under Access Manager > Audits.