Frequently Asked Questions

What is the Sundeck Private Broker?

The private broker is a lightweight, stateless service that acts as a proxy between SQL clients and Snowflake, deployable entirely within a customer’s VPC. The Private Broker is provided as a Docker image, and thus is suitable to be hosted and managed in a variety of ways, from standalone to an orchestration framework.

What happens if the Private Broker container crashes or restarts?

There is no impact for existing user sessions. The PB rebuilds all the required session state on its restart.

Can I switch Sundeck tenants within an instance of Private Broker?

Currently, the Sundeck Private Broker supports only a single Sundeck SaaS tenant at a time.

Does the private broker have any storage or state ? Does it have any external dependencies?

The Private Broker is stateless and does not persist any state. It has no dependencies except the obvious ones (Snowflake, Sundeck’s SaaS Control Plane, and the container environment hosting the Private Broker container).

How do Pinned Tables work in Private Broker?

The private broker fetches the metadata related to Pinned Tables (eg. table name, column list) from the Sundeck SaaS Control Plane, then fetches the contents of the Pinned Table(s) from Snowflake periodically (based on the refresh interval) using Sundeck Service Account credentials which are passed to the Private Broker on startup (via environment variables).

User will not perceive any difference in the behaviour of Pinned Tables between Sundeck’s SaaS Broker solution and Private Broker.

What happens to Pinned Table data if the Private Broker restarts?

At Private Broker startup, data is fetched from Snowflake for all Pinned Tables and pinned into broker memory. All Pinned Table data is loaded before the Broker is up and able to accept incoming queries (guaranteeing that no queries arrive at the Broker before it has the data needed to make decisions).

While the broker is populating the Pinned Table(s) during startup, all incoming user requests to Private Broker will fail/timeout with a connection error like “Could not connect to snowflake backend after 2 attempt(s)”. Normally, the Pinned Table refresh is quite fast (a few seconds) so this should not impact user queries.

Some Pinned Tables may not be populated during startup if:

An error is encountered while populating the pinned table from Snowflake
If populating the pinned table takes longer than 5 mins