Release 9.0.37.1¶

Partial Encryption Support¶

• Introduced partial encryption feature to encrypt First N or Last N characters of data.
• This enhancement supports both ALPHANUMERIC and TEXT data types, enabling more granular control over sensitive data protection.

Resolved an Issue for Streaming Foreach Query in Databricks FGAC¶

• Fixed an issue in Spark streaming jobs where foreachBatch operations were failing when only checkpoint locations were specified.
• The fix improves handling of optional settings in streaming queries, ensuring better reliability for data processing operations.

Dashboard Enhancements: Service Resource Loader and Service Permissions Loader Metrics¶

Updated the Connector Common Dashboard to improve visibility into connector activity by introducing enhanced metric panels for Service Resource Loader and Service Permissions Loader.

Fixed Java Version Mismatch Causing UnsupportedClassVersionError During Audit Log Processing for GBQ Connector.¶

• Resolved an issue where a Java version mismatch caused a UnsupportedClassVersionError during audit log processing in the GBQ Connector by aligning the Java compilation and runtime environments.

Fixed an Issue Where Role Member Associations Were Skipped When Group Creation Was Disabled for Unity Catalog Connector.¶

• Member updates are now correctly processed when member management is enabled, ensuring accurate role-to-user/group mapping in all scenarios.

Enhanced Databricks UC Thread Pool Management to Prevent Stalls During Resource and Permission Loading.¶

• Improved thread pool configuration and management to prevent system stalls, ensuring smoother and more reliable resource and permission loading operations.

[DBX-SQL] Faster and More Reliable Event-Driven Resource Loading for Databricks SQL.¶

Fix Details:

• Resolved an issue affecting resource loading when the CONNECTOR_DATABRICKS_SQL_ANALYTICS_LOAD_EXTENDED_TABLES_IN_SEPARATE_THREAD option was set to false.

Enhancements:

• Resource loading performance has been significantly improved.
• Multiple tables from the same database included in a single event are now loaded together in one consolidated query, reducing the number of queries and lowering warehouse load.
• Enhanced parallel processing allows tables to load concurrently in separate threads, achieving up to 5x faster performance.

Enhanced Databricks SQL Thread Pool Management to Prevent Stalls During Resource Loading and Permission Loading.¶

• Optimized thread pool handling to eliminate bottlenecks and ensure consistent performance during resource and permission loading operations.

Resolved Issue with Character Length for request_info in Tasks.¶

• Updated the request_info column type to LONGTEXT in MySQL for tasks.
• Added a validator to gracefully handle corrupted or invalid JSON data.

OTEL Agent and Node Exporter Disabled by Default¶

The Prometheus Node Exporter and OTEL Agent DaemonSets are now disabled by default to reduce the monitoring stack footprint in Kubernetes clusters.

If you are upgrading from a previous release, the OTEL Agent will remain enabled. To manually disable it, run the following commands:

1
2
3
4
5

```bash
cd ~/privacera/privacera-manager/output/kubernetes/helm/privacera-monitoring/
./install_monitoring.sh delete oa
rm -rf otel-agent
```

For more information on the functionality of these daemonsets and instructions for enabling them, refer to the following documentation:

• Enable Prometheus Node Exporter
• Enable OTEL Agent

Partial Encryption Support – First/Last n Characters¶

Enhanced encryption capabilities now support encrypting only the first or last n characters of a value, while leaving the remaining characters unchanged. This feature is applicable only to Alphanumeric and Text data types.