Azure data factory concatenation of columns

saikumar ellendula 6 Reputation points
2020-06-05T16:16:02.697+00:00

Hi,

for one of the requirement in azure data factory we need to derive a primary key column based on the parameter p_primary_key_cols

Input data:
int_col|varchar_col|date_col

10|xyz|2020-02-13

20|abc|2020-03-12

pipeline parameter:p_primary_key_cols='int_col,date_col'

expected output:
int_col|varchar_col|date_col|primary_key

10|xyz|2020-02-13|10~2020-02-13

20|abc|2020-03-12|20~2020-03-12

kindly help in deriving this

Thanks,
saikumar

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,870 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. HimanshuSinha-msft 601 Reputation points
    2020-06-08T18:08:04.487+00:00

    Hello @saikumar ellendula ,

    You can achive this by using Data flow . You will have to pass the primary_key as the parameter and use the derevied column option . You can read more on this here

    Please feel free to reach out to , if you need any help on the implemenation .


  2. HimanshuSinha-msft 19,476 Reputation points Microsoft Employee
    2020-06-15T21:21:33.74+00:00

    Hello @saikumarellendula-8111 ,

    Apoloziges for the delay in response .

    We have ADF with a paramter whene we pass the column name with a separator . We will use this paramter in dataflow(DF) . We will be using the derieved column transformation . Its very basic implementation and you can definetely build upon this . Please have the look and the image below .

    10131-adf-ui.gif

    Thanks & stay safe

    Himanshu


    Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.