Troubleshooting for PEG integration in Databricks

Use the following steps to collect diagnostic information and resolve issues with UDF usage and PEG integration in Databricks.

• Check the UDF Version:
  1. Navigate to the following path in Databricks to verify the UDF version: dbfs:/privacera/cluster-logs/<CLUSTER_NAME>/pegv2/privacera_version.txt
  2. Replace with the actual name of your Databricks cluster.
  3. Navigate to the following path in Databricks and check the following files pegv2,privacera.out,privacera_version.txt: dbfs:/privacera/cluster-logs/<CLUSTER_NAME>/
• To collect cluster logs:
  1. In the Databricks workspace, go to Compute.
  2. Select your cluster.
  3. Open Driver Logs to review runtime logs.
• Collect PEG service and installation Logs:
  1. User must specify logging location
  2. To specify that in databricks cluster UI go to Configuration and in Logging specify path where logs should be collected.
  3. This file contains detailed logs for the PEG service, including UDF installation status
  4. Review the file to check for errors or incomplete steps during installation.
• If any issues occurs, please share these files pegv2,privacera.out,privacera_version.txt, cluster logs and installation Logs.

Comments