Synapse Pipelines: output of lookup activity

Question

Sangeetha Priya S 210

Hi,

I am new learner to Synapse Analytics !

I am trying to store output of lookup activity to table in database or trying to store in temporary table or CSV files in Gen2 account.

I could not find option to use output of lookup activity as source dataset in copy activity.

Could you help here.

Sangeetha Priya S 210 Reputation points

2023-06-28T06:42:35.4166667+00:00

Hi SatishBoddu-MSFT,

Please find below screenshot

I am trying to take output of my lookup activity and set it to variable through set variable activity and trying to take that as source dataset in copy activity to post that data in database.

But I could not find on how to use my output as source dataset in copy activity.
Sangeetha Priya S 210 Reputation points

2023-06-29T10:35:03.89+00:00

any update on my query
QuantumCache 20,676 Reputation points Moderator

2023-07-06T18:22:48.1333333+00:00

Hello @Sangeetha Priya S Sorry for the delayed response,

Could you please add info on what is the data format of the lookup output?

So that i can try the repro!

Answer accepted by question author

0 additional answers

Sangeetha Priya S 210 Reputation points

2023-06-28T06:42:35.4166667+00:00

Hi SatishBoddu-MSFT,

Please find below screenshot

I am trying to take output of my lookup activity and set it to variable through set variable activity and trying to take that as source dataset in copy activity to post that data in database.

But I could not find on how to use my output as source dataset in copy activity.
Sangeetha Priya S 210 Reputation points

2023-06-29T10:35:03.89+00:00

any update on my query
QuantumCache 20,676 Reputation points Moderator

2023-07-06T18:22:48.1333333+00:00

Hello @Sangeetha Priya S Sorry for the delayed response,

Could you please add info on what is the data format of the lookup output?

So that i can try the repro!

Answer 1

QuantumCache 20,676 Moderator

Could you please share more details on your ADF Pipeline?

What are the stages you have used in the pipeline? better would be to add a screenshot of your Pipeline activities!

Did you try to create the temporary table in your database or configure the sink dataset to create a CSV file?

Did you try to output the Lookup activity to a variable and then use it in the copy Activity?

Please share more info on what does your Lookup activity outputs?

Ok , make use of the Additional column in the Source Section and populate that column with the Set Variable. and FInally use the mapping .

User's image

Copy Data: Mapping part using the additional column.
User's image

If the response is helpful, please click "Accept Answer" and Click 'Yes'. So that we can close this thread.