delta live tables trigger

arkiboys 9,616 Reputation points
2023-09-13T05:35:02.6633333+00:00

hello,
I have created a delta live table pipeline with a trigger which is continuous.
Looking at the pipeline workflow it shows the status as Running with a green circular arrow...
every time there is a change, then this pipeline writes into the table...
Question:
does this pipeline write only the updates or re-loads the whole table from scratch on each change?

thanks

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,916 questions
0 comments No comments
{count} votes

Accepted answer
  1. Sedat SALMAN 13,080 Reputation points
    2023-09-13T06:17:28.1066667+00:00

    In a Delta Live Table pipeline with a continuous trigger, whether it writes only updates or re-loads the entire table depends on how you've configured the pipeline. Typically, it is designed to write only the incremental updates, not reload the entire table from scratch.

    https://docs.databricks.com/delta/index.html

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful