Creating Stores for Streaming Data
Last updated
Last updated
Before you write any queries, you must configure DeltaStream to connect to the store where data resides. This tutorial shows how to use the Web application to create a store. This is the first step to take before you process any data using DeltaStream SQL statements.
Note In addition to self-hosted services, for Kafka store types you can also configure Confluent Cloud and Amazon MSK in DeltaStream.
In the lefthand navigation, click Resources ( ) to display the Resources page.
Click + Add Store, and from the menu that displays click the store type you want (in this case, Kafka). Note Be sure to match the store type with the streaming store where streaming data resides.
Choose a unique Name for the store. Use only alphanumeric characters, dashes, and underscores, and limit the name to a maximum of 255 characters.
Select the Amazon Availability Zone.
Availability zone information indicates where data is stored or streams through.
Add at least one URI port to which to connect, then click +. Separate multiple entries with a comma.
Add a Schema Registry.
Optionally, complete the authentication options as appropriate for the store. See below for more information.
Click Add.
For more detailed information about common and store-specific authentication parameters, see Store Parameters in the Reference section.
We recommend you use an assumed IAM role to authenticate with Kinesis stores (below). We do not recommend you use AWS credentials.
To authenticate with Kinesis stores we recommend using an assumed IAM role; you can use AWS credentials to authenticate but we do not recommend that method.
Another way to authenticate for Kinesis stores is using the AWS credentials, which is not generally recommended:
