Data Factory Append

Question

Hey!

I am looking to see if there is any way to 'append' data in azure data factory.

Here is how my data flow looks, each of these datasets have two columns, instead of saving them all into separate files, can I append them together and save into one file?

Answer 1

Hi @Adrian ,

Thank you for posting query in Microsoft Q&A Platform.

If you are trying to appended columns from different sources then, You can achieve this using Surrogate Key transformation and Join Transformation.

• Use Surrogate Key transformation on each source data to get unique id columns.
• After that use Join transformation to join different sources data on the Unique column what we generated above.

If you are trying to append rows then you can use Union Transformation.

Hope this will help. Please let us know if any further queries. Thank you.

---------------------------

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a notification.