Can ADF V2 Data flow Derived column task alter same column in Mutiples flat files with one flow or task

AzeemK 516 Reputation points
2020-11-27T00:46:51.257+00:00

Hello,
I wanted to use Data flow derived column activity to alter same column name in multiple files , I ahve not seen any good tutorial or videos on that.

I have column called Account ID in four .csv files under ADLS Gen 2 folder 'MYFolder/2020/11 I wanted to use ADF V2 data flow to alter Account ID in all four files to 'XXXX' using Data flow. it should be source --->derived column and --->Sink .
I am able to one column at a time but want to go through all files in one data flow task , is that possible?
any articles on msdn or videos will be helpful

Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
0 comments No comments
{count} votes

Accepted answer
  1. HarithaMaddi-MSFT 10,146 Reputation points
    2020-11-27T08:19:17.6+00:00

    Hi @AzeemK ,

    Welcome to Microsoft Q&A Platform. Thanks for posting the query.

    Wildcard for reading source files and Column patterns in derived column can be used to achieve this. Below is GIF for implementation for 3 files where I have altered data in "Accountid" field to 1234 using derived column.

    43166-alterdatadataflowadf.gif

    Please suggest for further queries and we will be glad to assist.

    -----

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.