Config table in adf

Vineet S 1,370

How we can load table from config table In da pipeline using copy activity.. Help me with screenshot

Nandan Hegde 33,796 Reputation points MVP

2024-07-16T05:27:56.0566667+00:00

Hey Vineet,

Good day!

It seems recently there have been too many posts from you on QA and good to know on that aspect that the forum is helping you out.

But incase if you need your query to be resolved on a quick basis, please provide some good context of your ask rather than just 1 liner statements as those are ambiguous for us to help with.

Hope this helps!!

Now coming to the ask,

what is the source of config table?

And what do you mean by load the config table in pipeline?

Do you mean to reference the config table data within other activities in the data pipeline?

If that is the case, you can use lookup activity (assuming source is blob/SQL) but there is a limiation on the lookup activity w.r.t number and size of data returned
Vineet S 1,370 Reputation points

2024-07-16T18:11:44.61+00:00

5000 per batch also fine can you help me with copy activity changes

what is the source of config table?-- sql server

Do you mean to reference the config table data within other activities in the data pipeline?----yes

1 answer

Nandan Hegde 33,796 Reputation points MVP

2024-07-17T04:42:29.54+00:00

you can use a lookup activity to query any SQL statement from your SQL serve

Then use

@activity('Lookup1').output

to reference the value in other activities.

In case if you want to copy this query from 1 source to another, no need of lookup activity,

within copy activity source SQL aspect only, you can have your select query and you can map your sink as needed
Please sign in to rate this answer.
Nandan Hegde 33,796 Reputation points MVP

2024-07-17T04:42:45.6466667+00:00

Vineet S 1,370 Reputation points

2024-07-17T04:44:36.22+00:00

It is question for config table

Smaran Thoomu 19,795 Reputation points Microsoft Vendor

2024-07-18T11:07:43.6+00:00

@Vineet S By using the Copy Activity, you can load the config table data from the SQL Server source into your pipeline. Let me know if you have any further questions or concerns!

Vineet S 1,370 Reputation points

2024-07-18T12:41:05.56+00:00

can you share the flow from config to table in screenshot to replicate it

Vineet S 1,370 Reputation points

2024-07-18T18:22:37.8133333+00:00

any recommendations

Smaran Thoomu 19,795 Reputation points Microsoft Vendor

2024-07-23T05:59:14.9933333+00:00

Vineet S I think this relevant thread might be the similar approach that you're looking for https://learn.microsoft.com/en-us/answers/questions/552804/reading-the-settings-in-a-config-table

I hope this helps. Please let me know if you have any questions.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Config table in adf

1 answer

Your answer