Hi BhargavaGunnam-MSFT any chance to look at this?
ADF Dataflow - Bronze Delta Table to Silver Delta Table Merges delete completely bronze table
Edgar Bahilo Rodríguez
6
Reputation points
Hi,
I have the following pipelines:
- Onprem SQL Server Source to Landing Zone (in parquet):
- Landing to Bronze table (delta) where I am specifying to delete the parquet source files:
- Bronze to Silver where I want to perform upserts:
For some reason the second dataflow (where I am not specifiying to delete any source files, in fact you do not have this option in the UI) deletes all the files from the bronze delta table.
Is there any reason for this default behaviour???