WarpStream
Last updated
Last updated
WarpStream is an Apache Kafka® compatible data streaming platform built directly on object storage. It’s delivered as a single, stateless Go binary that eliminates much of the manual, error-prone Kafka housekeeping. With WarpStream, you no longer have to
manage local disks
rebalance brokers
operate ZooKeeper
WarpStream clusters can scale out, and in, instantaneously, without rebalancing.
This document walks you through setting up WarpStream to be used as a data Store in DeltaStream.
DeltaStream account - get access to DeltaStream by registering here.
WarpStream account - get access to WarpStream by registering here.
A WarpStream cluster up and running with active, populated topics.
Navigate to your WarpStream console and select the appropriate Cluster.
In the top row navigation, click Credentials.
Name the credential and then click + Create Credentials. Below we created the dsCred credential.
Follow the instructions, and save the credentials in a safe place.
Back in DeltaStream, navigate to the Resources section.
Click Add Store, and from the list that displays click Kafka.
Complete the requested information as follows:
Name - In this example WarpStream
Region - Select from the available areas the one most applicable
URLs to connect - Applicable bootstrap server and port — here, serverless.warpstream.com:9092
SASL Hash Function - select SHA512
Username - The username from the credential you created in WarpStream
Password - The password from the credential you created in WarpStream
When you're done, click Add.
Everything is now configured for you to define DeltaStream Objects and start executing Queries against your Apache Kafka® compatible WarpStream data stores.