ADF - how to copy and customize same pipeline from one subscription to another?

Nguyen, Hoa 331 Reputation points
2022-11-07T22:34:09.68+00:00

Hello,
I have a pipeline which is a chain of several sprocs, activities etc... My ADF uses user assigned managed identity of the relevant subscription, let's call it ArchiveUser and several Azure sql servers and azure blob storages.

Pipeline in Dev
Dev subscription
ArchiveUser set up in dev subscription
Azure sql servers in dev subscription
Azure blob storage in dev subscription

My question is how to copy and customize those settings for another subscription?

We have 4 subscriptions Dev, test, stage and prod.
Each of these subscriptions is meant to have the same pipeline with the exception of pointing to relevant resources in their appropriate subscription.
In traditional SSIS, there is a .DTSConfig which contains the config variables for these resources.

Thank you!

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,889 questions
0 comments No comments
{count} votes

Accepted answer
  1. BhargavaGunnam-MSFT 28,111 Reputation points Microsoft Employee
    2022-11-09T23:38:40.437+00:00

    Hello @Nguyen, Hoa ,

    Welcome to the MS Q&A platform.

    From your Dev pipeline, You can export the pipeline template by clicking on the "Export template" option as shown in the below screenshot.

    258921-image.png

    Once you have exported the template, open your test ADF(from another subscription) and import the template here by clicking on the "Import from pipeline template" option, as shown below.

    258818-image.png

    Please note, you will need to create the linked services during the Import process or choose the existing linked services. The data source is pulled from the import template.
    Also, if you already have a data set with the same name in the test data factory then the name will change to 'dataset1'(1 will be appended).

    I hope this helps. Please let me know if you have any further questions.

    ------------------------------

    • Please don't forget to click on 130616-image.png and upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

0 additional answers

Sort by: Most helpful