Azure data factory concatenation of columns

saikumar ellendula 6 Reputation points
2020-06-05T16:16:02.697+00:00

Hi,

for one of the requirement in azure data factory we need to derive a primary key column based on the parameter p_primary_key_cols

Input data:
int_col|varchar_col|date_col

10|xyz|2020-02-13

20|abc|2020-03-12

pipeline parameter:p_primary_key_cols='int_col,date_col'

expected output:
int_col|varchar_col|date_col|primary_key

10|xyz|2020-02-13|10~2020-02-13

20|abc|2020-03-12|20~2020-03-12

kindly help in deriving this

Thanks,
saikumar

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,073 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. HimanshuSinha-msft 601 Reputation points
    2020-06-08T18:08:04.487+00:00

    Hello @saikumar ellendula ,

    You can achive this by using Data flow . You will have to pass the primary_key as the parameter and use the derevied column option . You can read more on this here

    Please feel free to reach out to , if you need any help on the implemenation .


  2. HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
    2020-06-15T21:21:33.74+00:00

    Hello @saikumarellendula-8111 ,

    Apoloziges for the delay in response .

    We have ADF with a paramter whene we pass the column name with a separator . We will use this paramter in dataflow(DF) . We will be using the derieved column transformation . Its very basic implementation and you can definetely build upon this . Please have the look and the image below .

    10131-adf-ui.gif

    Thanks & stay safe

    Himanshu


    Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members