Skip to content

Configure Dremio REST Connection Timeout Properties

Privacera allows fine-grained configuration of REST connection timeout properties for the Dremio connector. These settings help maintain stable and reliable communication between Privacera and Dremio, especially in environments with variable network latency or high load.

Configuration

  1. SSH to the instance where Privacera Manager is installed.

  2. Run the following command to open the .yml file to be edited.

    If you have multiple connectors, then replace instance1 with the appropriate connector instance name.

    Bash
    1
    vi ~/privacera/privacera-manager/config/custom-vars/connectors/dremio/instance1/vars.connector.dremio.yml

  3. Add or update the following configuration properties as needed:

    YAML
     1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
    # Maximum time to wait for a connection from the pool (default: 300000 ms)
CONNECTOR_DREMIO_REST_CONNECTION_REQUEST_TIMEOUT_MS: "300000"

# Maximum time to establish a connection with Dremio REST endpoint (default: 300000 ms)
CONNECTOR_DREMIO_REST_CONNECTION_TIMEOUT_MS: "300000"

# Maximum time to wait for data on a socket after connection (default: 300000 ms)
CONNECTOR_DREMIO_REST_SOCKET_TIMEOUT_MS: "300000"

# Maximum retry attempts after socket timeout (default: 2)
CONNECTOR_DREMIO_REST_SOCKET_TIMEOUT_MAX_RETRY_ATTEMPTS: "2"

# Delay before retrying after socket timeout (default: 5000 ms)
CONNECTOR_DREMIO_REST_RETRY_DELAY_AFTER_SOCKET_TIMEOUT_MS: "5000"

  4. Once these properties are configured, update the Privacera Manager platform instance:

    Step 1 - Setup which generates the helm charts. This step usually takes few minutes.

    Bash
    1
2
    cd ~/privacera/privacera-manager
./privacera-manager.sh setup
    Step 2 - Apply the Privacera Manager helm charts.
    Bash
    1
2
    cd ~/privacera/privacera-manager
./pm_with_helm.sh upgrade
    Step 3 - Post-installation step which generates Plugin tar ball, updates Route 53 DNS and so on.

    Bash
    1
2
    cd ~/privacera/privacera-manager
./privacera-manager.sh post-install

Comments