Source to TArget for a new column in table

Question

Source to TArget for a new column in table

Santhi Dhanuskodi 66

Hi,

I have a source table/excel/csv data and done ETL to target SQL table.

Now if there is a new column introduced in the source data, how to replicate the data in target. Assume that there was already one load of data completed from source to target. What is the best way to deal this?

This is Azure Cloud specific question.

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2023-05-17T05:02:33.7066667+00:00

@Santhi Dhanuskodi - Just checking in to see if the below answers helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

2 answers

Your answer

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2023-05-17T05:02:33.7066667+00:00

@Santhi Dhanuskodi - Just checking in to see if the below answers helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

Olaf Helper 47,436

how to replicate the data in target.

By modifiying your ETL process manually.

Answer 2

Hey,

There are multiple ways depending on the source data type: full or delta

In case if the source data is always full ( you get the entire data always), then you can auto create the destination table :

User's image

https://learn.microsoft.com/en-us/answers/questions/35570/create-a-target-table-on-the-fly-in-data-factory

but in case if the source has delta data and your target table contains historical data(which no longer comes from source), then you would have to manually add the new column at source and sink and do the necessary mappings

Share via

Source to TArget for a new column in table

2 answers

Your answer