copy tables

Shahin Mortazave 486 Reputation points
2021-03-10T12:12:35.777+00:00

HI,

I have a demo environment for Azure Data Factory, I have setup pipeline to copy some tabled from my on-perm SQL server to an Azure SQL server. When trigger the pipeline on-perm tables get copied to the Azure DB.
Now I have to copy more tables from the same on-perm DB to the same SQL SQL Azure DB.
I did create a new data set in existing pipelines, now I see the original dataset with 4 tables and destination dataset and the newly added dataset for the new table, after triggered the pipeline I can see that only the tables from the first dataset get copied to the Azure and the newly added table is not get copied.

Any suggestion on how to add extra tables to existing pipeline?

Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,478 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Nandan Hegde 29,886 Reputation points MVP
    2021-03-10T13:14:22.82+00:00

    Hey @Shahin Mortazave
    Can you please share the image and json code of your pipeline
    Based on whatever data you have provided, it seems that you have created new datasets but you have not created new copy activity in the pipeline to map the data sets

    0 comments No comments

  2. Shahin Mortazave 486 Reputation points
    2021-03-10T14:14:27.473+00:00

    @Nandan Hegde Thank you for your reply,
    I agree with you, I have just create a new dataset and have no idea how to put this dataset in copy activity, should I create the dataset by editing the copy activity?
    These are some screenshots from my demo ADF:

    76386-workingdataset.jpg

    76345-newdataset.jpg

    76298-pipeline.jpg