Azure Data Factory Rest Linked Service sink returns Array Json

MarkV 0

I am developing a data copy from a DB source to a Rest API sink. The issue I have is that the JSON output gets created with an array object. I was curious if there is any options to remove the array object from the output. So I do not want: [ {id:1,value:2}, {id:2,value:3} ] Instead I want {id:1,value:2} {id:2,value:3}

AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-04-18T07:47:37.8+00:00

MarkV , Just checking in to see if the below answer helped. Please do consider clicking Accept Answer as accepted answers help community as well. Also, please click on Yes for the survey 'Was the answer helpful'
AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-04-24T06:59:27.31+00:00

Hi MarkV , Just following up to see if the below answer helped. Please do consider clicking Accept Answer as accepted answers help community as well. Also, please click on Yes for the survey 'Was the answer helpful'

1 answer

AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-04-13T16:49:13.8466667+00:00

Hi MarkV , Welcome to Microsoft Q&A platform and thankyou for posting your question here. As per my understanding, you want to convert your array of jsons into json . Please let me know if that is not the ask.

You can try using flatten transformation in mapping dataflow in order to do so. It is used to take array values inside hierarchical structures such as JSON and unroll them into individual rows.

To know more about the flattening transformation and its implementation , kindly check out the below resources: Flatten transformation in mapping data flow Flatten transformation in ADF How to flatten the nested json using mapping dataflow Hope it helps. Kindly accept the answer .
Please sign in to rate this answer.
MarkV 0 Reputation points

2023-04-13T18:28:48.7733333+00:00

unfortunately, we cannot use a data flow because of the frequency of the pipeline. we are only doing the data transformation within a data pipeline.

AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-04-18T07:55:57.0066667+00:00

MarkV , In that case , you can simply use a set variable activity to replace the symbols '[',']', and ',' with Blank string i.e. ''.

You can try the following expression to do so: @json(replace(replace(replace(string(activity('activityname').output),'[',''),']',''),',',''))

Let me know how it goes. Thankyou

AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-04-19T04:05:52.84+00:00

MarkV , Just following up to see if the above answer helped. Please do consider clicking Accept Answer as accepted answers help community as well. Also, please click on Yes for the survey 'Was the answer helpful'
Sign in to comment

Share via

Azure Data Factory Rest Linked Service sink returns Array Json

1 answer