Okay @Anmol Ganju . Here is another way to do it. This example (for brevity) does 3 batches, but you can see the pattern to extend to more.
- Lookup. Gets the table
- Lookup branches into a Filter activity for each batch, to isolate the records for the batch
- Each Filter activity has its own corresponding ForEach loop to do all the tables for that batch. This has the benefit of allowing you to fine-tune the exact amount of parallelism.
- There is a green on-success dependency from "ForEach Batch 1" to "ForEach Batch 2", and from "ForEach Batch 2" to "ForEach Batch 3". The ForEach only runs when the previous ForEach completes.
- Inside the ForEach is the Copy activity
Picture below.