How to merge two csv by rownumber use azure datafactory

ri,shoshun 431 Reputation points
2021-06-24T02:32:30.537+00:00

I would like to merge the following two CSV files (rest api data file and rest api response file). Please tell me how to do it.
CSV1:
ID, Name
1001, Nm1001
1002, Nm1002
CSV2:
status, message
success,
fail, XXXError
Expected file:
ID, Name, status, message
1001, Nm1001, success,
1002, Nm1002, fail, XXXError

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
0 comments No comments
{count} votes

Answer accepted by question author
  1. ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator
    2021-06-24T17:21:03.733+00:00

    Hi @ri,shoshun ,

    Thank you for posting query in Microsoft Q&A Platform.

    We can achieve this using dataflows in Azure data factory. Below is the detailed explanation of implementation.

    Step1: Add two source transformations for both csv files.

    109048-sourcetransformations.gif

    Step2: Add Surrogate key Transformation on both sources to get unique key column

    109114-surrogatetransformations.gif

    Step3: Add Join Transformation to inner join on Surrogate key column values

    109115-jointransformation.gif

    Step4: Select Transformation to select only desired columns(remove your surrogate key columns).

    109077-selecttransformation.gif

    Step5: Finally apply Sink Transformation to load data in to your target storage

    Hope this will help. Thank you

    ----------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a email-notifications

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.