Dynamic table creation in Pre-Copy script through ADF

Mohanraj 105 Reputation points

Hi All,

I have parquet files year, month wise in ADLS. Now, I need to copy the data from these parquet files and push it to corresponding customer tables in Azure SQL Managed instance. In the destination we don't have these customer tables already create. So, I want to dynamically check if the table exists in destination location before copying the data and if the table is not there then I need to dynamically create those individual customer tables and then push the data.

Is it possible?



SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
11,002 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,031 questions
0 comments No comments
{count} votes

Accepted answer
  1. Suba Balaji 8,546 Reputation points


    You can use copy activity and auto create table option in the sink settings to achieve what you want. Please go through this documentation for more details. For you to use this feature, make sure to pass the table name to data set dynamically.

    Here is a video reference for the same.

    Hope it helps.


0 additional answers

Sort by: Most helpful