ForEach Loop Copy Activity

Question

All,

I want to copy set of tables from SQLServer (On-Prem) onto AzureSQL database. I used the CopyData tool to set this one up and it works fine.

However, I want the tables to be copied in parallel. In the ForEach Loop screen, in the Settings Tab, The Sequential box is not checked which means it can execute in parallel. I set the "Batch Count" set to 30.

In the settings tab of Copy Activity, I have set "Degree Of Parellelism" to 32.

With all these settings, I see only two SPIDs on the source. Is there any way I can enhance the parallelism of the copy activity. Or else, I will have to create multiple pipelines.

https://learn.microsoft.com/en-us/azure/data-factory/control-flow-for-each-activity#parallel-execution.

Thanks,
grajee

Answer 1

When you run the pipeline, it should trigger multiple copy activities in parallel. Does this happen and did you check in Monitor section? Steps you followed seems correct and enough