how to capture output of append variable in adf and write to json or csv file in adls

Ravi Yaramati 1

i have a set up like below , i need to capture data from for each activity to json or csv

1 answer

KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2021-07-13T07:26:20.42+00:00

Hi @Ravi Yaramati ,

Welcome to Microsoft Q&A forum and thanks for posting your query.

One way to achieve this requirement is by utilizing "Add additional columns during copy" feature as explained in this stackoverflow thread - [Transfer the output of 'Set Variable' activity into a json file Azure Data Factory

After your append variable activity, have a subsequent Copy activity and define a column and pass the value of append variable as described in stackoverflow thread.

Hope this info helps. Do let us know if you have further query.

----------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2021-07-14T21:24:00.217+00:00

Hi @Ravi Yaramati ,

Just checking in to see if the above information was helpful. If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Thank you

KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2021-07-15T19:43:43.287+00:00

Hi @Ravi Yaramati ,

We still have not heard back from you. Just wanted to check if the above suggestion was helpful? If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Ravi Yaramati 1 Reputation point

2021-07-17T06:29:21.97+00:00

Hello @KranthiPakala-MSFT

i have gone through stack overflow thread earlier as well, but no luck , as it say point dataset to json , but to create dataset we need linked service point connection ,

1) where should we place or point dataset link service to point to

2) if we tried placing source adls link service and created json dataset , but this seems like we to place output of variable to json (sink) , but source , json seems invalid

can you suggest if there is any other way , other than this

Regards

Ravi

KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2021-07-21T20:30:51.977+00:00

Hi @Ravi Yaramati ,

Thanks for your response and apologies for the delayed reply.

1) where should we place or point dataset link service to point to

You will have to create a linked service pointing to the sink data store where you would want to write the sink data (csv/json based on the requirement).

2) if we tried placing source adls link service and created json dataset , but this seems like we to place output of variable to json (sink) , but source , json seems invalid - Sorry I didn't get this ask here, could you please elaborate a bit so that we can better assist on this?

Thank you

KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2021-07-22T21:46:45.413+00:00

Hi @Ravi Yaramati ,

We still haven't heard back from you. Could you please confirm the above details for further assistance on this.

Thank you
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

how to capture output of append variable in adf and write to json or csv file in adls

1 answer

Your answer