Azure data factory deploy, single pieline deploy to production

Dondapati, Navin 281 Reputation points
2020-06-12T17:18:58.347+00:00

Hi Guys,

We have Azure data factory in production with multiple pipelines already deployed; we have deployed new pipeline and its in different folder uses different connects and datasets; And we use ARM template import for deployment; but now when i export; it does not allow me to extract only delta, but fetch all the exiting pipeline details as well.

How do i make sure i fetch only what required for deployment; our Team does not use DEvOps for incremental deploy; and devops is not solution we are looking for.

By the way our source code is in git hub.

Regards,
Navin

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,135 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,061 Reputation points
    2020-06-15T21:14:30.007+00:00

    Hello @NavinDondapati and thank you for your question.

    The Export ARM template always exports the entire factory, and this cannot be changed.

    One possible alternative could use features of github to detect which files in the repository changed since the last deployment, and pass those JSON files to powershell commandlets to deploy only those. This approach avoids using ARM templates.


    Thank you

    Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.