Snowflake Integration Guide
Review the following guide for setting up an integration between Litmus Edge and the Snowflake data warehouse.
You will need a Snowflake account with the SysAdmin privilege.
You will need to create a database in Snowflake that will be used to receive the data from Litmus Edge.
To create the Snowflake database:
- Log in to Snowflake.
Navigate to Data > Databases.
Click + Database. The New Database dialog displays.
Enter a name for the database. Optionally, add a comment.
- Click Create. The new database is created.
Click the new database name, and then click + Schema. The New Schema dialog displays.
Enter a name for the schema. Optionally, add a comment.
New Schema dialog- If needed, select the checkbox for Managed access.
- Click Create. The new schema is created.
You can now set up the connector in Litmus Edge to send data to this new database and schema.
Follow the steps to Add a Connector and select the DB - Snowflake provider.
Configure the following parameters.
- Name: Enter a name to identify the connector.
- Account: Enter the Snowflake account ID and region. Refer to your Snowflake account info in the bottom-left corner of the Snowflake account page. See Account Identifiers to learn more. Format: <accountid>.<region> Example: vt97594.ca-central-1.aws
- Username: Enter your Snowflake username.
- Password: Enter your Snowflake password.
- Database: Enter the database name you configured in Step 3.
- Schema: Enter the schema name you configured in Step 3.
- Warehouse: Enter the warehouse name that will be used for the integration. Navigate to Admin > Warehouse for your list of current warehouses. See Virtual Warehouses to learn more.
- Table: Enter a table name where the data will be displayed.
- Create table: Select this checkbox if the table name configured doesn't exist yet. A new table will be created.
- Commit timeout: Enter the transaction commit timeout in (ms).
- Max transaction size: Enter the maximum number of messages before a transaction is committed, regardless of timeout parameter.
- Bulk insert count: To buffer messages, enter a value. Bulk insert will be performed once this value is reached.
- Throttling limit: The maximum number of messages per second to be processed. The default value is zero, which means that there is no limit.
- Persistent storage: When enabled, this will cause messages to undergo a store-and-forward procedure. Messages will be stored within Litmus Edge when cloud providers are online.
- Queue Mode: Select the queue mode as lifo (last in first out) or fifo (first in first out). Selecting lifo means that the last data entry is processed first, and selecting fifo means the first data entry is processed first.
After adding the connector, click the toggle in the connector tile to enable it.
If you see a Failed status, you can review the Connector Logs and relevant error messages.
You will now need to import the tags you added in Step 2 to the connector as topics.
Ensure the topics you imported are enabled by returning to the Topics tab and clicking the Enable all topics icon.
Access the Snowflake database you created to verify that data is successfully being sent.