commit (DataSourceStreamReader)

Informs the source that Spark has completed processing all data for offsets less than or equal to end and will only request offsets greater than end in the future.

Added in Databricks Runtime 15.2

Syntax

commit(end: dict)

Parameters

Parameter	Type	Description
end	dict	The latest offset that the streaming query has processed for this source.