Skip to content

BigQuery Connector – Custom Properties

This page explains the custom properties available for the BigQuery connector and provides step-by-step instructions for configuring them in the Privacera Self-Managed Portal.

Available Custom Properties

Click to view custom properties for BigQuery connector
Property Name Description Default Value Supported Values
ranger.policysync.connector.0.load.resources Controls which method to be used to load resources from bigquery load_multi_thread load_from_dataset_columns, load_multi_thread
ranger.policysync.connector.0.load.resources.load.table.thread.count Maximum number of threads to load the tables inside the configured databases 2 Any numeric value
ranger.policysync.connector.0.load.resources.load.table.thread.min.count Minimum number of threads to load the tables inside the configured databases 2 Any numeric value
ranger.policysync.connector.0.load.resources.load.column.thread.count Maximum no. of threads to load the columns inside the configured tables 3 Any numeric value
ranger.policysync.connector.0.load.resources.load.column.thread.min.count Minimum no. of threads to load the columns inside the configured tables 3 Any numeric value
ranger.policysync.connector.0.load.table.size Load table batch size in a single thread task 500 Any numeric value
ranger.policysync.connector.0.sync.interval.sec Set the interval for resource sync process in seconds 60 Any numeric value in seconds
ranger.policysync.connector.0.sync.serviceuser.interval.sec Set the interval for principal sync process in seconds 420 Any numeric value in seconds
ranger.policysync.connector.0.sync.servicepolicy.interval.sec Set the interval for existing policies sync process in seconds 540 Any numeric value in seconds
ranger.policysync.connector.0.audit.interval.sec Set the interval for getting access audits process in seconds 30 Any numeric value in seconds
ranger.policysync.connector.0.user.filter.with.email Enables filtering of users based on email domain false true, false
ranger.policysync.connector.0.user.use.email.as.service.name Enables using email as service name for user true true, false
ranger.policysync.connector.0.manage.user.filterby.role Set to true to manage only the users who belongs to the roles defined in manage roles list property false true, false
ranger.policysync.connector.0.column.access.control.type Sets the method of column level access control to be used by policysync view view
ranger.policysync.connector.0.policy.name.separator Sets the separator to use while creating name for native row filter policy _ Any valid string
ranger.policysync.connector.0.row.filter.policy.name.template Sets template to create name for native row filter policy row_filter_item_ Any valid string
ranger.policysync.connector.0.masking.functions.dataset.name Sets the dataset name to create custom masking functions privacera_dataset Any valid dataset name
ranger.policysync.connector.0.secure.view.project.name.prefix Sets the project name prefix for secure views "" Any valid string
ranger.policysync.connector.0.secure.view.project.name.postfix Sets the project name postfix for secure views "" Any valid string
ranger.policysync.connector.0.secure.view.name.remove.suffix.list Sets the list of suffix strings to be removed from the secure view name "" Any valid string
ranger.policysync.connector.0.secure.view.dataset.name.remove.suffix.list Sets the list of suffix strings to be removed from the secure view dataset name "" Any valid string
ranger.policysync.connector.0.secure.view.project.name.remove.suffix.list Sets the list of suffix strings to be removed from the secure view project name "" Any valid string
ranger.policysync.connector.0.perform.grant.updates.max.retry.attempts Sets the maximum number of retry attempts for grant or revoke updates 2 Any numeric value
ranger.policysync.connector.0.perform.grant.updates.batch Enables batch processing for grant or revoke updates true true, false
ranger.policysync.connector.0.audit.log.load.max.interval.minutes Sets the maximum interval for loading audit logs in minutes 30 Any numeric value in minutes
ranger.policysync.connector.0.audit.progress.report.tracker.enable Enables progress report tracker for audit logs false true, false
ranger.policysync.connector.0.audit.progress.complete.report.enable Enables progress report for completed audit logs true true, false
ranger.policysync.connector.0.audit.progress.complete.report.interval.sec Sets the interval for progress report for completed audit logs in seconds 1800 Any numeric value in seconds
ranger.policysync.connector.0.permissionloader.progress.report.tracker.enable Enables progress report tracker for permission loader logs false true, false
ranger.policysync.connector.0.permissionloader.progress.complete.report.enable Enables progress report for completed permission loader logs true true, false
ranger.policysync.connector.0.permissionloader.progress.complete.report.interval.sec Sets the interval for progress report for completed permission loader logs in seconds 1800 Any numeric value in seconds
ranger.policysync.connector.0.principalloader.progress.report.tracker.enable Enables progress report tracker for principal loader logs false true, false
ranger.policysync.connector.0.principalloader.progress.complete.report.enable Enables progress report for completed principal loader logs true true, false
ranger.policysync.connector.0.principalloader.progress.complete.report.interval.sec Sets the interval for progress report for completed principal loader logs in seconds 1800 Any numeric value in seconds
ranger.policysync.connector.0.resourceloader.progress.report.tracker.enable Enables progress report tracker for resource loader logs false true, false
ranger.policysync.connector.0.resourceloader.progress.complete.report.enable Enables progress report for completed resource loader logs true true, false
ranger.policysync.connector.0.resourceloader.progress.complete.report.interval.sec Sets the interval for progress report for completed resource loader logs in seconds 1800 Any numeric value in seconds
ranger.policysync.connector.0.changelog.progress.report.tracker.enable Enables progress report tracker for change log loader logs true true, false
ranger.policysync.connector.0.changeprocessor.progress.report.tracker.enable Enables progress report tracker for change processor logs true true, false
ranger.policysync.connector.0.resourcesink.progress.report.tracker.enable Enables progress report tracker for resource sink logs true true, false
ranger.policysync.connector.0.rangerprincipalloader.progress.report.enable Enables progress report tracker for ranger principal loader logs true true, false
ranger.policysync.connector.0.rangerprincipalloader.progress.report.interval.sec Sets the interval for progress report for completed ranger principal loader logs in seconds 1800 Any numeric value in seconds

How to Add Custom Properties via Privacera Portal

Note

  • The values shown below are for example purposes only. Be sure to replace them with the actual custom properties and values listed in the table above.

Restart Required

Any changes to the custom properties require restarting the application for the updates to take effect.

  1. Navigate to Settings → Applications in the Self-Managed Portal.

  2. Select BigQuery from the list of Connected Applications.

  3. Click the application name or the (edit) icon, then select Access Management.

  4. In the ADVANCED tab, add the desired property under the Add New Custom Properties section. For example:

    YAML
    1
    ranger.policysync.connector.0.native.public.group.masking.identity.name=<domain_name>

  5. Click SAVE to apply the changes.

Comments