Azure data factory deploy, single pieline deploy to production

Dondapati, Navin 291 Reputation points
2020-06-12T17:18:58.347+00:00

Hi Guys,

We have Azure data factory in production with multiple pipelines already deployed; we have deployed new pipeline and its in different folder uses different connects and datasets; And we use ARM template import for deployment; but now when i export; it does not allow me to extract only delta, but fetch all the exiting pipeline details as well.

How do i make sure i fetch only what required for deployment; our Team does not use DEvOps for incremental deploy; and devops is not solution we are looking for.

By the way our source code is in git hub.

Regards,
Navin

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,507 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,236 Reputation points
    2020-06-15T21:14:30.007+00:00

    Hello @NavinDondapati and thank you for your question.

    The Export ARM template always exports the entire factory, and this cannot be changed.

    One possible alternative could use features of github to detect which files in the repository changed since the last deployment, and pass those JSON files to powershell commandlets to deploy only those. This approach avoids using ARM templates.


    Thank you

    Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.