Share via


STREAMING_CHECKPOINT_METADATA_ERROR error condition

SQLSTATE: 42616

Error with streaming checkpoint metadata.

COMMIT_LOG_V3_MISSING_SINK_METADATA

If using spark.sql.streaming.commitLog.formatVersion >= 3, sink metadata information must be provided. Some streaming modes are incompatible with this format version (continuous mode, async progress tracking, async state checkpointing); please fix the configs and try again.

DETECTED_PENDING_CONTROL_BATCH

Detected pending control batch for operationType=<operationType> with batchId=<batchId> and queryId=<queryId>. Retry the control operation and rerun the query.

DETECTED_RUNNING_QUERY

Detected running streaming query with ID <queryId>. Stop the running query before performing rewind.

INVALID_COMMIT_LOG_METADATA

Found invalid commit log metadata for batch <batchId> with format version <commitLogFormatVersion>. Please rerun the query with the correct config.

MISSING_COMMIT_PROGRESS

Error occurred while time travel is enabled for batch <batchId>. Please disable time travel or contact Databricks support.

NO_QUERY_ID_FOUND

No streaming query ID found at checkpoint location <checkpointLocation>. Check if the checkpoint location is valid.

REWIND_COMMIT_MISSING_SINK_METADATA

Attempted to rewind to batch <batchId> at checkpoint location <checkpointLocation> but it was not created with spark.sql.streaming.commitLog.formatVersion >= 3. No sink metadata available in commit log. Please retry with a batch with sink metadata available, or rerun the query with the correct config.

REWIND_OFFSET_MISSING_METADATA

Attempted to rewind to batch <batchId> at checkpoint location <checkpointLocation> but no metadata is available in the offset log. Please retry with a batch that has metadata available.

SKIP_OFFSETS_INVALID_SOURCE_ID

Invalid source ID <sourceId> in skipOffsets at batchId=<batchId> does not exist in available source IDs=<availableSourceIds> for checkpoint location <checkpointLocation>. Please check if the query was modified to remove this source and re-add it.

SOURCE_DOES_NOT_SUPPORT_SKIP_OFFSETS

Source <sourceName> does not support skipping offsets. Please remove this source from the query or rewind without skipping offsets.