Creating Stores for Streaming Data
Before writing any queries, DeltaStream needs to be configured to connect to the store where data resides. This tutorial shows how to use the web application to create a Store as the first step to process any data using DeltaStream SQL statements.
For Kafka store types, in addition to self-hosted services, Confluent Cloud and Amazon MSK can also be configured in DeltaStream.
Create a Store
From the left menu, click Stores > Create Store:
Select the Store Type.
The Store Type should match the streaming Store where streaming data resides.
Choose a unique Name for the Store.
Select the Amazon Availability Zone.
Availability zone information indicates where data is stored or streams through.
Enter a unique Name.
Store names are limited to a maximum of 255 characters. Only alphanumeric characters, dashes, and underscores are allowed.
Add one or more URLs of the Store to connect to.
Click NEXT.
(Optional) Complete the Authentication options as appropriate for the Store. See Authentication Parameters for more information.
Click SAVE.
Authentication Parameters
See Store Parameters for more information about common and Store specific authentication parameters.
Kafka Authentication Parameters
Confluent Authentication Parameters
Kinesis Authentication Parameters
The recommended way to authenticate with Kinesis stores is using an assumed IAM role:
Another way to authenticate for Kinesis stores is using the AWS credentials, which is not generally recommended:
Last updated