Clarify incremental refresh logic: “Extract data from the past” is relative to current datetime
When configuring incremental refresh in Microsoft Fabric Dataflow Gen2, the option “Extract data from the past” is a powerful feature. However, it would be beneficial if the UI or documentation clearly stated that this value is calculated relative to the current datetime at the time of refresh, not based on the data itself.
For example, a note like this would be handy:
“Extract data from the past” is calculated using the current datetime when the refresh runs, and filters data based on the selected column. It does not evaluate relative to values inside your dataset.
This clarification would help prevent confusion for users who mistakenly believe the calculation is based on their data column (e.g., DateCreated
Rather than the system time, which can result in accidental duplicate records or missed incremental loads.
The platform overall is excellent, and adding this small note would improve usability and data accuracy for many users.