Share via

data factory pipelines deployment

arkiboys 9,711 Reputation points
2021-12-30T08:11:34.02+00:00

Hello,
I would like to start looking into how to deploy the pipelines from Dev to prod using CI/CD
In Dev, I have a-lot of pipelines and only a number of them should go to production.
How do I select only the ones that need to go to prod?
Thank you

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.


Answer accepted by question author

MartinJaffer-MSFT 26,161 Reputation points
2021-12-30T18:24:52.4+00:00

Hello @arkiboys .

Ideally, you would merge your feature branches into the collaboration branch. The collaboration branch is then exported to the adf_publish branch when you do a publish. Everything in there would get deployed. So whatever you want to deploy should be in the collaboration branch. There is no mechanism for cherry-picking only some items from collaboration branch for publish.
Document link on normal process.

There is a hotfix process you can read about. It basically is finding a commit which contains only the items you want and exporting the template of that branch.

The common thread in both of these is the selection is done by what you include in a branch.

Was this answer helpful?

0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.