question

abdulkalam-1616 avatar image
0 Votes"
abdulkalam-1616 asked abdulkalam-1616 commented

How to concat REST API coulmns at Azure Data Factory copy activity

I am using REST API source and cosmos DB sink in Azure Data Factory Copy activity.
The REST API sample output is below.

{
"Metadata" : [
{
"count" : 100
"page_num" : 1,
"page_count" : 1,
"total_count" : 5
}
],
"data" : [
{
"Code":"ABC123","Year":"2021",Description":"TestDescription1"
},
{
"Code":"ABC456","Year":"2021",Description":"TestDescription2"
},
{
"Code":"ABC789","Year":"2021",Description":"TestDescription3"
},
{
"Code":"XYZ123","Year":"2021",Description":"TestDescription4"
},
{
"Code":"XYZ456","Year":"2021",Description":"TestDescription5"
},
]
}

The requirement to concatenating Code+Year and store as a new column in cosmos. I didnt find any clue ? any help on this please ?


azure-data-factorypartner-center-api
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

ShaikMaheer-MSFT avatar image
0 Votes"
ShaikMaheer-MSFT answered abdulkalam-1616 commented

Hi @abdulkalam-1616 ,

Thank you for posting query in Microsoft Q&A Platform.

If I understand correctly, you would like to concatenate two columns and then load to sink using copy activity. Please correct me If my understanding is incorrect.

Copy activity cannot perform any kind of data transformations or data manipulations. It will only allow us to perform Data movement. Your scenario cannot be done using copy activity. You can consider using Dataflows for this kind of transformations.

In Data flows consider using derived column transformation for implementing your scenario of concatenation.

Below are few useful resources to refer.

Hope this helps. Please let us know if any further queries.


Please consider hitting Accept Answer. Accepted answers help community as well.

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks you Maheer



0 Votes 0 ·