WarpStream

WarpStream is an Apache Kafka® compatible data streaming platform built directly on object storage. It’s delivered as a single, stateless Go binary that eliminates much of the manual, error-prone Kafka housekeeping. WarpStream, automatically handles tasks such as

• managing local disks

• rebalancing brokers

• operating ZooKeeper

WarpStream clusters can scale out, and in, instantaneously, without rebalancing.

This document walks you through setting up WarpStream to be used as a data Data Store in DeltaStream.

Step 1: Setting up the WarpStream credentials

Prerequisites

1. DeltaStream account - get access to DeltaStream by registering here.

2. WarpStream account - get access to WarpStream by registering here.

3. A WarpStream cluster up and running with active, populated topics.

Create a WarpStream credential

1. Navigate to your WarpStream console and select the appropriate cluster.

2. In the top row navigation, click Credentials.

1. Name the credential and then click + Create Credentials. Below we created the dsCred credential.

1. Follow the instructions, and save the credentials in a safe place.

Step 2: Connect DeltaStream to WarpStream

1. Back in DeltaStream, navigate to the Resources page.

2. Click + Add Data Store, and when the Choose a Data Store window displays, click Kafka.

1. Complete the requested information as follows:

   1. Name - In this example, WarpStream.

   2. URLs to connect - Applicable bootstrap server and port — here, serverless.warpstream.com:9092

   3. SASL Hash Function - select SHA512

   4. Username - The username from the credential you created in WarpStream

   5. Password - The password from the credential you created in WarpStream

When you're done, click Add.

Next Steps

Everything is now configured for you to define DeltaStream Objects and start executing Queries against your Apache Kafka® compatible WarpStream data stores.