Merge 2 CSV file

Vineet S 1,390 Reputation points
2024-08-16T15:46:26.49+00:00

How to merge 2 CSV files in adf pipeline using sql queries or something

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
{count} votes

1 answer

Sort by: Most helpful
  1. hossein jalilian 10,825 Reputation points Volunteer Moderator
    2024-08-16T16:23:18.1733333+00:00

    Thanks for posting your question in the Microsoft Q&A forum.

    You can use the Copy Data activity or Data Flow, depending on whether the files have the same schema or different schemas.

    Add the source datasets pointing to the folder containing your CSV files. Use a wildcard file path to select all files you want to merge

    • In the Copy Data activity, select the source dataset with the wildcard path
    • Set the sink dataset to the location where you want the merged CSV file to be stored
    • In the Copy Activity settings, choose the Merge files option to combine the data from the source files into a single output file

    Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.