Del via


STATE_REWRITER_INVALID_CHECKPOINT error condition

SQLSTATE: 55019

The state rewrite checkpoint location '<checkpointLocation>' is in an invalid state.

MISSING_COMMIT_METADATA

You might have set a very low value for 'spark.sql.streaming.minBatchesToRetain' config during the streaming query execution

or you deleted files in the checkpoint location.

MISSING_KEY_ENCODER_SPEC

Key state encoder spec is expected for column family '<colFamilyName>' but was not found.

Please make sure the checkpoint is from a supported Spark version (Spark 4.0+) or DBR 14.3+.

MISSING_OPERATOR_METADATA

No stateful operator metadata was found for batch <batchId>.

Ensure that the checkpoint is for a stateful streaming query and the query ran on a Spark version that supports operator metadata (Spark 4.0+) or DBR 14.3+.

UNSUPPORTED_STATE_STORE_METADATA_VERSION

Unsupported state store metadata version encountered.

Only StateStoreMetadataV1 and StateStoreMetadataV2 are supported.