Loading data using Copy Data activity in ADF parallel

Question

Hi team i have one situation,

Lets says I want to pull 500 tables from SQL Server and create separate csv files. i.e 500 csv files.

We will use LookUp, For loop, Copy Data activity to this process task. Can we create a prallel copy activity so my last table is not dependent on first table

Answer 1

Hi @Sarvesh Pandey ,

Thank you for posting query in Microsoft Q&A Platform.

You can achieve this by using only one copy activity inside Foreach activity.

Use Lookup activity to get table names from SQL. Then all table names array to ForEach activity to iterate over each table name. Inside Foreach activity use Copy activity to copy that specific table and storage as file. Please Note, here source and sink datasets in copy activity should be parameterized.

Click here to know about how to parameterize datasets.

Hope this helps. Please let us know if any further queries.

---------
Please consider hitting Accept Answer and Up-vote button. Accepted answers help community as well.