Databricks Zerobus Ingest
Databricks integration enables Edge System to connect with Databricks via Zerobus Ingest. For more information, see the Databricks Zerobus Ingest Integration Guide.
Supported Communication
- Outbound (Write from Edge to Databricks): Yes
- Inbound (Read from Databricks to Edge): No
Connector Configuration
Field | Type | Description | Required | Default |
|---|---|---|---|---|
Name | String | User defined name of connector instance | Yes | - |
Workspace URL | String | Databricks workspace URL (for example, https://abcd-teste2testspcse2.cloud.databricks.com) | Yes | - |
Zerobus Server URL | String | Databricks Zerobus Server URL AWS format: .zerobus..cloud.databricks.com Azure format: .zerobus..azuredatabricks.net | Yes | - |
Client ID | String | OAuth client ID to authenticate with Databricks | Yes | - |
Client Secret | String (Secret) | OAuth client secret to authenticate with Databricks | Yes | - |
Catalog | String | Databricks Catalog name | Yes | - |
Schema | String | Databricks Schema name | Yes | - |
Default Table | String | Default table name to publish data | Yes | - |
Record Type | Dropdown | Data record format: JSON | Yes | JSON |
Batch Ingest | Integer | Set to 1 to use single ingest and >1 for batch ingest | No | 1 |