ADF V2: renaming attributes of Parquet to attributes of target table

Question

Hi,

I will simplify my example to make it (at least for myself :) ) more understandable.
I have a dataflow in Azure Data factory V2 which can accept multiple input files, but one at a time.
Each file contains records with logical keys that have to be written to a target table.

Example:

Three files, each with logical keys, but in each file the logical key names are different. Code and Type or Name and Type etc.
In the target table the names of these fields are Code_1 and Number_1

How can I , in a generic way, always rename the attributes of the Parquet to those of the target table?

Probably in a derived column activity, but I dont know how
Hope somenone can help

Thnx in advance
Ron

Answer 1

Hi @Poel van der, RE (Ron) ,

Thank you for asking this question. To achieve this, you have to do the following (please see the screenshots for details):

1. Create Dataset with empty schema or For existing Dataset, clear the schema
2. Derived columns based on the fields you required e.g., Code_1: toString(coalesce(toString(byName('Code')), toString(byName('Name')), toString(byName('Extract_Code')))) Number_1: toString(coalesce(toString(byName('Type')), toString(byName('Number'))))
3. Map fields in the Sink

Hope this helps. Thanks!

----------

If the above response helps, please "accept as answer" and "up-vote" it. Thanks!

Answer 2

HI @Nasreen Akter

it works, thnx very much

Regards
Ron