LogoLogo
Start Trial
  • Overview
    • What is DeltaStream?
    • Core Concepts
      • Access Control
      • Region
      • SQL
      • Store
      • Database
      • Query
      • Visualizing Data Lineage
      • Function
  • Getting Started
    • Free Trial Quick Start
    • Starting with the Web App
    • Starting with the CLI
  • Tutorials
    • Managing Users and User Roles
      • Inviting Users to an Organization
      • Administering Users in your Organization
      • Using the CLI to Manage User Roles
      • Example: Setting Up Custom Roles for Production and Stage
    • Creating Stores for Streaming Data
    • Using Multiple Stores in Queries
    • Creating Relations to Structure Raw Data
    • Namespacing with Database and Schema
    • Creating and Querying Materialized Views
    • Creating a Function
    • Securing Your Connections to Data Stores
      • Introducing DeltaStream Private Links
      • Creating an AWS Private Link from DeltaStream to your Confluent Kafka Dedicated Cluster
      • Enabling Private Link Connectivity to Confluent Enterprise Cluster and Schema Registry
      • Creating a Private Link from DeltaStream to Amazon MSK
      • Creating a Private Link for RDS Databases
      • Deleting a Private Link
    • Integrations
      • Connecting to Confluent Cloud
      • Databricks
      • PostgreSQL
      • Snowflake
      • WarpStream
    • Serialization
      • Working with ProtoBuf Serialized Data and DeltaStream Descriptors
      • Working with Avro Serialized Data and Schema Registries
      • Configuring Deserialization Error Handling
  • Reference
    • Enterprise Security Integrations
      • Okta SAML Integration
      • Okta SCIM Integration
    • Metrics
      • Prometheus Integration
      • Built-In Metrics
      • Custom Metrics in Functions
    • SQL Syntax
      • Data Formats (Serialization)
        • Serializing with JSON
        • Serializing with Primitive Data Types
        • Serializing with Protobuf
      • Data Types
      • Identifiers and Keywords
      • Command
        • ACCEPT INVITATION
        • CAN I
        • COPY DESCRIPTOR_SOURCE
        • COPY FUNCTION_SOURCE
        • DESCRIBE ENTITY
        • DESCRIBE QUERY
        • DESCRIBE QUERY METRICS
        • DESCRIBE QUERY EVENTS
        • DESCRIBE QUERY STATE
        • DESCRIBE RELATION
        • DESCRIBE RELATION COLUMNS
        • DESCRIBE ROLE
        • DESCRIBE SECURITY INTEGRATION
        • DESCRIBE <statement>
        • DESCRIBE STORE
        • DESCRIBE USER
        • GENERATE COLUMNS
        • GENERATE TEMPLATE
        • GRANT OWNERSHIP
        • GRANT PRIVILEGES
        • GRANT ROLE
        • INVITE USER
        • LIST API_TOKENS
        • LIST DATABASES
        • LIST DESCRIPTORS
        • LIST DESCRIPTOR_SOURCES
        • LIST ENTITIES
        • LIST FUNCTIONS
        • LIST FUNCTION_SOURCES
        • LIST INVITATIONS
        • LIST METRICS INTEGRATIONS
        • LIST ORGANIZATIONS
        • LIST QUERIES
        • LIST REGIONS
        • LIST RELATIONS
        • LIST ROLES
        • LIST SCHEMAS
        • LIST SCHEMA_REGISTRIES
        • LIST SECRETS
        • LIST SECURITY INTEGRATIONS
        • LIST STORES
        • LIST USERS
        • PRINT ENTITY
        • REJECT INVITATION
        • REVOKE INVITATION
        • REVOKE PRIVILEGES
        • REVOKE ROLE
        • SET DEFAULT
        • USE
      • DDL
        • ALTER API_TOKEN
        • ALTER SECURITY INTEGRATION
        • CREATE API_TOKEN
        • CREATE CHANGELOG
        • CREATE DATABASE
        • CREATE DESCRIPTOR_SOURCE
        • CREATE ENTITY
        • CREATE FUNCTION_SOURCE
        • CREATE FUNCTION
        • CREATE INDEX
        • CREATE METRICS INTEGRATION
        • CREATE ORGANIZATION
        • CREATE ROLE
        • CREATE SCHEMA_REGISTRY
        • CREATE SCHEMA
        • CREATE SECRET
        • CREATE SECURITY INTEGRATION
        • CREATE STORE
        • CREATE STREAM
        • CREATE TABLE
        • DROP API_TOKEN
        • DROP CHANGELOG
        • DROP DATABASE
        • DROP DESCRIPTOR_SOURCE
        • DROP ENTITY
        • DROP FUNCTION_SOURCE
        • DROP FUNCTION
        • DROP METRICS INTEGRATION
        • DROP RELATION
        • DROP ROLE
        • DROP SCHEMA
        • DROP SCHEMA_REGISTRY
        • DROP SECRET
        • DROP SECURITY INTEGRATION
        • DROP STORE
        • DROP STREAM
        • DROP USER
        • UPDATE ENTITY
        • UPDATE SCHEMA_REGISTRY
        • UPDATE SECRET
        • UPDATE STORE
      • Query
        • APPLICATION
        • Change Data Capture (CDC)
        • CREATE CHANGELOG AS SELECT
        • CREATE STREAM AS SELECT
        • CREATE TABLE AS SELECT
        • Function
          • Built-in Functions
          • Row Metadata Functions
        • INSERT INTO
        • Materialized View
          • CREATE MATERIALIZED VIEW AS
          • SELECT (FROM MATERIALIZED VIEW)
        • Query Name and Version
        • Resume Query
        • RESTART QUERY
        • SELECT
          • FROM
          • JOIN
          • MATCH_RECOGNIZE
          • WITH (Common Table Expression)
        • TERMINATE QUERY
      • Sandbox
        • START SANDBOX
        • DESCRIBE SANDBOX
        • STOP SANDBOX
      • Row Key Definition
    • Rest API
Powered by GitBook
On this page
  • Syntax
  • Description
  • Arguments
  • Examples
  1. Reference
  2. SQL Syntax
  3. Query

Resume Query

Syntax

INSERT INTO relation_name
select_statement ...
QUERY WITH('resume.from.query.id' = query_id);

INSERT INTO relation_name
select_statement ...
QUERY WITH('resume.from.query.name' = query_name, 'resume.from.query.version' = query_version);

Description

When launching a query, the resume.from.query.id, resume.from.query.name, and resume.from.query.version properties allow a query to resume processing from where a previously terminated query stopped.

In order to resume from a previous query, the following constraints must be met:

  • Applications are not currently supported.

  • Source Relations must be using a Kafka Store.

  • Queries with aggregation, joins, or pattern recognition are not supported.

  • Both the terminated and new query should only have one source relation.

  • The topic and store of the source relation must be the same.

Arguments

resume.from.query.id

resume.from.query.name

resume.from.query.version

Examples

Launch a query resuming from a previous query

The following is an example of how to launch a Query which is resumed from a previous query identified by a Query ID.

demodb.public/demostore# LIST QUERIES;
+--------------------------------------+-----------+----------+-----------------+---------------+-------------------------------------------------------------------------------------------+----------+-------------------------------+-------------------------------+
|                  ID                  |    Name   |  Version |  Intended State |  Actual State |                                                           Query                           |   Owner  |           Created At          |           Updated At          |
+--------------------------------------+-----------+----------+-----------------+---------------+-------------------------------------------------------------------------------------------+----------+-------------------------------+-------------------------------+
| 89f21634-39a0-44e4-979d-9f35017a8ca0 | DemoQuery |        1 | running         | new           | CREATE STREAM demostream AS SELECT * FROM pageviews QUERY WITH('query.name' = "DemoQuery"); | sysadmin | 2024-07-30 20:00:01 +0000 UTC | 2024-07-30 20:00:05 +0000 UTC |
+--------------------------------------+-----------+----------+-----------------+---------------+-------------------------------------------------------------------------------------------+----------+-------------------------------+-------------------------------+

demodb.public/demostore# TERMINATE QUERY 89f21634-39a0-44e4-979d-9f35017a8ca0;
+-------+--------------------------------------+----------+-----------------------------------------------------------------------+
|  Type |                 Name                 |  Command |                                Summary                                |
+-------+--------------------------------------+----------+-----------------------------------------------------------------------+
| query | 89f21634-39a0-44e4-979d-9f35017a8ca0 | DROP     | query 89f21634-39a0-44e4-979d-9f35017a8ca0 was marked for termination |
+-------+--------------------------------------+----------+-----------------------------------------------------------------------+

demodb.public/demostore# DESCRIBE QUERY STATE 89f21634-39a0-44e4-979d-9f35017a8ca0;
+-------------------------+-------------+------------------------------+-----------+
|      Relation Name      |  Store Type |             Info             |   State   |
+-------------------------+-------------+------------------------------+-----------+
| demodb.public.pageviews | KAFKA       | partition:0,offset:106615757 | completed |
+-------------------------+-------------+------------------------------+-----------+

demodb.public/demostore# INSERT INTO demostream SELECT * FROM pageviews QUERY WITH('query.name' = "DemoQuery", 'resume.from.query.id' = "89f21634-39a0-44e4-979d-9f35017a8ca0" );
+-------+--------------------------------------+----------+---------------------------------------------------------------------+
|  Type |                 Name                 |  Command |                               Summary                               |
+-------+--------------------------------------+----------+---------------------------------------------------------------------+
| query | fe544108-bb58-44b0-8108-8fd9842d1b4d | CREATE   | query fe544108-bb58-44b0-8108-8fd9842d1b4d was successfully created |
+-------+--------------------------------------+----------+---------------------------------------------------------------------+

The following is an example of how to launch a Query which is resumed from a previous query identified by a Query Name and Version.

demodb.public/demostore# INSERT INTO demostream SELECT * FROM pageviews QUERY WITH('query.name' = "DemoQuery", 'resume.from.query.name' = "DemoQuery" , 'resume.from.query.version' = 1);
+-------+--------------------------------------+----------+---------------------------------------------------------------------+
|  Type |                 Name                 |  Command |                               Summary                               |
+-------+--------------------------------------+----------+---------------------------------------------------------------------+
| query | 74798e4e-6b72-4cab-a2a3-af8b4748e9bd | CREATE   | query 74798e4e-6b72-4cab-a2a3-af8b4748e9bd was successfully created |
+-------+--------------------------------------+----------+---------------------------------------------------------------------+
PreviousQuery Name and VersionNextRESTART QUERY

Last updated 8 months ago

This is the unique identifier of the Query to resume from. See to find out how to list all Queries that the user has access to. The first column (ID) in the response corresponds with the query_id.

This is the name of the Query to resume from. See to find out how to list all Queries that the user has access to. The column (Name) in the response corresponds with the query_name. The resume.from.query.version property disambiguates between multiple queries with the same name.

This is the version of the Query to resume from. See to find out how to list all Queries that the user has access to. The column (Version) in the response corresponds with the resume.from.query.version.

LIST QUERIES
LIST QUERIES
LIST QUERIES