Nóta
Aðgangur að þessari síðu krefst heimildar. Þú getur prófað aðskrá þig inn eða breyta skráasöfnum.
Aðgangur að þessari síðu krefst heimildar. Þú getur prófað að breyta skráasöfnum.
Commits this microbatch with a list of commit messages.
This method is invoked on the driver when all tasks run successfully. The commit messages are collected from the write() method call from each task and passed to this method. The implementation should use the commit messages to commit the microbatch in the streaming sink.
Syntax
commit(messages: List[Optional[WriterCommitMessage]], batchId: int)
Parameters
| Parameter | Type | Description |
|---|---|---|
messages |
list of WriterCommitMessage | A list of commit messages. If a write task fails, the commit message will be None. |
batchId |
int | An integer that uniquely identifies a batch of data being written. The integer increases by 1 with each microbatch processed. |