Skip to main content

Databricks

J
Written by Johan Åkerman

Prerequisite: Third-party connectors are available only on the Sana Enterprise tier, with one exception: the Workday connector is included for both Sana Core and Sana Enterprise.

Introduction

Connect Databricks to Sana to manage jobs, runs, SQL warehouses, serving endpoints, and vector search indexes. Monitor your data platform and trigger workflows directly from Sana.

In summary, the connector has the following key characteristics:

  • Category: Engineering

  • Connector type: Real-time

  • Auth type: API keys

  • Hosting type: Managed

Capabilities

This connector is able to do the following:

Capability

List jobs

Create jobs

Run jobs

Manage SQL warehouses

List endpoints

Create endpoints

Query vector indexes

Manage vector indexes

Tools

While the capabilities above describe what the connector can do at a high level, the underlying tools show exactly which operations the agent can use when you ask Sana about Databricks. In practice, the agent may call one or more tools to achieve a single capability.

Tool

Cancel all runs

Cancel run

Create endpoint

Create job

Create sql warehouse

Create vector search index

Delete endpoint

Delete job

Delete run

Delete sql warehouse

Delete vector search index

Delete vector search index data

Edit sql warehouse

Export run

Get endpoint

Get job

Get job permissions

Get run

Get run output

Get sql warehouse

Get sql warehouse config

Get sql warehouse permissions

Get vector search index

List endpoints

List jobs

List runs

List sql warehouses

List vector search indexes

Query vector search index

Query vector search index next page

Repair run

Reset job

Run job now

Scan vector search index

Set job permissions

Set sql warehouse config

Set sql warehouse permissions

Start sql warehouse

Stop sql warehouse

Sync vector search index

Update job

Upsert vector search index data

Note: This article lists the connector's full set of tools. Your workspace owner can disable individual tools for your workspace, so some of those listed here may not be available to your agents. If a tool you expected is missing, reach out to your workspace owner.

Scope and permissions

This connector uses API keys. When you connect your account, we securely store your keys to connect to this connector's APIs. The scopes for this connector depends on the scopes you assign your API key in Databricks when generating the key.

Set up instructions

Prerequisites:

  • You are a Sana Enterprise user – all third-party connectors except the Workday connector are available only for users on the Sana Enterprise tier.

  • Your Sana workspace owner has enabled this connector – if the workspace owner has disabled the connector it won't appear in the list of available connectors.

Step 1: Go to the connectors page in Sana

In Sana, click on your profile icon and name in the bottom left corner and select Connectors.

Step 2: Find Databricks in the list of available connectors

Scroll to the Available connectors section and locate Databricks.

Note: If you can't find a connector in this list, it means one of the following:

  1. You've already connected it — check the ”Active connectors” section at the top of the connectors page, or

  2. Your workspace owner has disabled this connector for your workspace — reach out to them for more information or to request that it be enabled.

Step 3: Hover the connector card and click the connect button

Hover the Databricks card and click the Connect button.

Tip: If you click the card itself instead of the Connect button, you'll open a connector detail page with more information about its capabilities.

Step 4: Initialize the Pipedream connection

When clicking Connect in the previous step, a pop-up will appear powered by Pipedream. Click the Continue button in the pop-up to initialize the set up.

Note: Sana uses Pipedream to connect your account. Pipedream is a Workday product, trusted by millions of people to keep their data secure.

Step 5: Provide your Databricks credentials

You'll be asked to paste the credentials for Databricks so Sana can store them securely and use them to call the connector's APIs on your behalf.

Step 6: Complete the set up

You've successfully connected your Databricks account. Click Continue to complete the setup and start using the connector.

Did this answer your question?