Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,840 questions
Bulk load of tables between databases
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 86%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELK%3C/text%3E%3C/svg%3E)
Lisa Kruger
60
Reputation points
Hi All, Is there a way to to bulk load tables between two databases? In SSIS i used Foreach container, please provide a link or a document. I do not want to copy to ADLS2 but between 2 databases. Thanks
{count} votes
-
Nandan Hegde 32,416 Reputation points MVP2023-04-13T02:54:21.02+00:00 Hey, Can you please provide some additional details as to what is the amount of data that you want to sync? There are multiple options:
- use ADF with source and sink as the respective database tables
- use data sync functionality to sync the tables
-
Lisa Kruger 60 Reputation points
2023-04-13T12:09:35.35+00:00 @Nandan hegde Thanks Nandan, not sure I understood. My source db has 50 tables and I want to copy them over to another db , both are in Azure (Azure SQL DB'S) , I can copy them individually, but looking for an option, where I can iterate through all tables and load them. Can you please provide me with a link regarding the syncing of the tables between db's? Thanks
-
Nandan Hegde 32,416 Reputation points MVP
2023-04-13T12:19:23.0066667+00:00 Hey, The below blogs can help: https://key2consulting.com/how-to-copy-multiple-tables-from-on-premise-to-cloud-in-azure-data-factory/
https://www.modern-dataengineering.com/post/how-to-copy-multiple-tables-in-azure-data-factory wherein you would have to use a for each iteration whose input would be the tablenames. within for each activity you would have Copy activity with source and sink as Azure SQL database and the table names across both source and sink datasets would be the foreach iteration item value -
PRADEEPCHEEKATLA 90,226 Reputation points2023-04-19T08:17:20.11+00:00
Lisa Kruger - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help. -
Lisa Kruger 60 Reputation points
2023-05-07T19:20:19.0866667+00:00 @PRADEEP CHEEKATLA and @Nandan hegde , for my scenario, the sync option wont work as PROD to DW sync will remove the additional views and tables we have in DW.
Thanks
Sign in to comment
Sign in to answer