Config discovery scan
Once the data source connection test is successful, you can follow the steps outlined here to add a resource for Discovery Scanning.
Ways to Add a Resource for Scanning:¶
Formats for Adding Resources for Scanning¶
For Realtime Scanning, you need to add resource in the below formats, depending on the data source:
Resource format for Realtime scanning
- AWS S3 :
s3://folder_name/*
- AZURE ADLS:
/container_name/*
- GCP GCS:
gs://folder_name/*
- GCP GBQ:
project_id.dataset_name/*
For Offline Scanning, you need to add the resource in the below formats, depending on the data source:
After adding the resource for scanning, it will be displayed in the following formats on the portal UI.
Resource format for AZURE ADLS
Resources can be added in the following formats for Discovery Scanning:
You need to add the resource in the Resource field, or you can type *
in the field and select the required resource from the suggestion list
/container_name
/container_name/folder_child/
/container_name/*
/container_name/filename.format
Resource format for AWS S3
Resources can be added in the following formats for Discovery Scanning:
You need to add the resource in the Resource field, or you can type *
in the field and select the required resource from the suggestion list
s3://folder_name
s3://folder_name/folder_child/
s3://folder_name/*
s3://folder_name/filename.format
Resource format for GCP GCS
Resources can be added in the following formats for Discovery Scanning:
You need to add the resource in the Resource field, or you can type *
in the field and select the required resource from the suggestion list
gs://folder_name
gs://folder_name/folder_child/
gs://folder_name/*
gs://folder_name/filename.format
Resource format for JDBC APPLICATION
Resources can be added in the following formats for Discovery Scanning:
You need to add database_or_schema in Database_Name field and table_name in Table_Name field OR You can add *
in the field and select required resource from the suggestion list.
database_OR_schema_name/table_name
*/table_name
database_OR_schema_name/*
*_database_OR_schema_*/*_table_*
Resource format for DATABRICKS UNITY CATALOG
Resources can be added in the following formats for Discovery Scanning:
You need to add dbx_catalog.schema_name in the Database_Name field and table_name in the Table_Name field, or you can type *
in the field and select the required resource from the suggestion list.
dbx_catalog.schema_name/table_name
dbx_catalog.*/table_name
dbx_catalog.schema_name/*
dbx_catalog.*_schema_*/*_table_*
Resource Format for Snowflake
Resources can be added in the following formats for Discovery Scanning:
You need to add snowflake_database.schema_name in Database_Name field and table_name in Table_Name field OR You can add *
in the field and select required resource from the suggestion list.
snowflake_database.schema_name/table_name
snowflake_database.*/table_name
snowflake_database.schema_name/*
snowflake_database.*_schema_*/*_table_*