Databricks
Write data back to a Databricks table. Use Zeotap to materialize model results, audience memberships, or enriched data into Databricks Delta tables.
Prerequisites
- A Databricks workspace
- A SQL warehouse or cluster with the SQL Statement Execution API enabled
- A personal access token or OAuth service principal credentials
Authentication
Databricks supports two authentication methods:
Personal Access Token
- In Databricks, go to User Settings > Access Tokens
- Generate a new personal access token (starts with
dapi) - Paste it into the Access Token field in Zeotap
OAuth (Service Principal)
- Create a service principal in Databricks
- Generate a Client ID and Client Secret
- Enter both values in Zeotap
Configuration
| Field | Type | Required | Description |
|---|---|---|---|
| Server Hostname | Text | Yes | Databricks workspace hostname (e.g., abc-defgh.cloud.databricks.com) |
| HTTP Path | Text | Yes | SQL warehouse HTTP path (e.g., /sql/1.0/warehouses/abc123) |
| Catalog | Text | No | Unity Catalog name (optional). Default: hive_metastore |
| Schema | Text | No | Default schema (optional). Default: default |
Target Settings
| Field | Type | Required | Description |
|---|---|---|---|
| Target Catalog | Text | No | Target catalog (optional) |
| Target Schema | Text | Yes | Target schema (e.g., default) |
| Target Table | Text | Yes | Target table name |
Supported Operations
Sync Modes: Upsert, Insert, Update, Mirror
Audience Sync Modes: Add, Remove, Mirror, Upsert
Features
- Field Mapping: Yes
- Schema Introspection: Yes — Zeotap reads table metadata via the SQL Statement Execution API
How It Works
Zeotap uses the SQL Statement Execution API for all operations:
- Data is loaded using INSERT INTO VALUES statements
- MERGE INTO is used for upsert operations
- Delta Lake manages versioning and ACID transactions
Troubleshooting
Connection failed
Verify the Server Hostname and HTTP Path. The HTTP Path is found in the SQL Warehouse details page under Connection details.
If your workspace uses IP access lists, add Zeotap’s static egress IPs (34.76.7.172, 34.22.225.249) to the allowlist. See Network Configuration for the full setup.
Token expired
Personal access tokens can expire. Generate a new token in Databricks User Settings.
Table not found
Verify the catalog, schema, and table name. For Unity Catalog, ensure the catalog is accessible to the authenticated user.
The target table does not need to exist beforehand: Zeotap creates it on the first sync, with every mapped column typed as STRING. The principal needs CREATE TABLE on the target schema. The connection test only checks that the schema is reachable, so a missing CREATE TABLE privilege surfaces on the first run rather than at setup.
SQL warehouse not running
The SQL warehouse must be running to execute queries. Check the warehouse status in the Databricks SQL Warehouses page.