Azure Synapse Link for Dataverse Append Option Pros and Cons

Question

Kindly help us, the Azure Synapse Link for Dataverse with Azure Data Lake, while adding or manage the tables, there is advanced setting while choose the tables for Append only ( Yes or No ), if I choose Yes, the partition automatically choose Yearly and if we go for Append No, the partition will be like Month. we would like explain what is pros and cons if we choose Yes and NO. the document also not much information available.

https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-data-lake

above link provide information as below only, please help us on more details.

The Count column shows the number rows written. When Append only is set to No, this is the total number of records. When Append Only is set to Yes, this is the total number of changes. The Append only and Partition strategy columns show the usage of different advanced configurations.

what is pros and cons if enable Yes and No option in Append mode, what is best practice to use.

Kindly share your comments for this.

Answer 1

Hi @Karthik Elavan ,

Thank you for posting query in Microsoft Q&A Platform.

In simple terms to explain, Azure Synapse Link actually perform copy data from your Source to Data lake. While copying data based on partitions it creates files in Data lake storage account.

Selecting Append Yes, will actually help you to improve your performance. As data here is getting appended. In simple terms, you can think of its like incremental load. When you select Append No then it's like all records loading. Hence when you select Append No, then count shows total number of records.

Hope this helps. Please let me know if any further queries.

----------------

Please consider hitting Accept Answer button. Accepted answers help community as well.