Confusing Documentation For Fabric Incremental Refresh
The documentation for Fabric Incremental Refresh is a bit confusing. Taking the example, with the options specified here:
My understanding is the following steps:
Step 1: Fabric will first check all of the rows in the table to see if the maximum value of the "ModifiedDate" column has increased. If the maximum value has increased in this column (for 1 or more rows), then continue. Else, fabric will not continue on to the next steps and won't change anything.
Step 2: Fabric will split the rows in buckets based on the "OrderDate". If their is actual data on each day for the past 2 weeks in this OrderDate column, then their will be 14 bucket since the bucket size is 1 day and their are 14 days in 2 weeks. Fabric will then process these 14 buckets in parallel.
Step 3: Fabric will replace each of the rows in the destination table having an OrderDate column value in the past 2 weeks, with the rows from all of the buckets in the previous step. If their is a row that has an OrderDate column value that is older than 2 weeks ago, Fabric will not replace these rows.
Please let me know if this understanding is correct, and if not please explain which part is incorrect.
Thanks!