Create Data Stores for Streaming Data

Before you write any queries, you must configure DeltaStream to connect to the data store where data resides. This article shows how to use the Web application to create a data store.

This is the first step to take before you process any data using DeltaStream SQL statements.

Note In addition to self-hosted services, for Kafka data store types you can also configure Confluent Cloud and Amazon MSK in DeltaStream.

Creating a Data Store

In the lefthand navigation, click Resources ( ) to display the Resources page.
Click + Add Store, and from the menu that displays click the data store type you want (in this case, Kafka).

Note Be sure to match the data store type with the streaming store where streaming data resides.

Choose a unique Name for the data store. Use only alphanumeric characters, dashes, and underscores, and limit the name to a maximum of 255 characters.
If indicated, add at least one URI port to which to connect, then click +. Separate multiple entries with a comma.
Complete the authentication options as appropriate for the data store. See below for more information.
Click Add.

Authentication Parameters

For more detailed information about common and store-specific authentication parameters, see Store Parameters in the Reference section.

Kafka Authentication Parameters

Confluent Authentication Parameters

Kinesis Authentication Parameters

We recommend you use an assumed IAM role to authenticate with Kinesis stores (below). We do not recommend you use AWS credentials.

To authenticate with Kinesis stores we recommend using an assumed IAM role; you can use AWS credentials to authenticate but we do not recommend that method.