Config table in adf

Vineet S 385

How we can load table from config table In da pipeline using copy activity.. Help me with screenshot

Nandan Hegde 31,111 Reputation points MVP

2024-07-16T05:27:56.0566667+00:00

Hey Vineet,

Good day!

It seems recently there have been too many posts from you on QA and good to know on that aspect that the forum is helping you out.

But incase if you need your query to be resolved on a quick basis, please provide some good context of your ask rather than just 1 liner statements as those are ambiguous for us to help with.

Hope this helps!!

Now coming to the ask,

what is the source of config table?

And what do you mean by load the config table in pipeline?

Do you mean to reference the config table data within other activities in the data pipeline?

If that is the case, you can use lookup activity (assuming source is blob/SQL) but there is a limiation on the lookup activity w.r.t number and size of data returned
Vineet S 385 Reputation points

2024-07-16T18:11:44.61+00:00

5000 per batch also fine can you help me with copy activity changes

what is the source of config table?-- sql server

Do you mean to reference the config table data within other activities in the data pipeline?----yes

1 answer

Nandan Hegde 31,111 Reputation points MVP

2024-07-17T04:42:29.54+00:00

you can use a lookup activity to query any SQL statement from your SQL serve

Then use

@activity('Lookup1').output

to reference the value in other activities.

In case if you want to copy this query from 1 source to another, no need of lookup activity,

within copy activity source SQL aspect only, you can have your select query and you can map your sink as needed
Please sign in to rate this answer.
Nandan Hegde 31,111 Reputation points MVP

2024-07-17T04:42:45.6466667+00:00

Vineet S 385 Reputation points

2024-07-17T04:44:36.22+00:00

It is question for config table
Sign in to comment