How to publish only some pipelines in adf using cicd azure devops

Question

How to publish only some pipelines in adf using cicd azure devops

Ksenija Saulic 0

Is there an option to modify build.yml file to take only some pipelines in CICD process for ADF using Azure Devops?

AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator

2024-01-18T06:06:00.46+00:00

Hi Ksenija Saulic , Just following up to see if the below answer helped. Please do consider clicking Accept Answer as accepted answers help community as well. Also, please click on Yes for the survey 'Was the answer helpful'
AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator

2024-01-22T05:49:46.8133333+00:00

Hi Ksenija Saulic , Just checking to see if you got a chance to check the below answer which covers the resolution for your query. Hope it helped. Kindly accept the answer by clicking on Accept answer button. Thankyou

2 answers

Your answer

AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator

2024-01-18T06:06:00.46+00:00

Hi Ksenija Saulic , Just following up to see if the below answer helped. Please do consider clicking Accept Answer as accepted answers help community as well. Also, please click on Yes for the survey 'Was the answer helpful'
AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator

2024-01-22T05:49:46.8133333+00:00

Hi Ksenija Saulic , Just checking to see if you got a chance to check the below answer which covers the resolution for your query. Hope it helped. Kindly accept the answer by clicking on Accept answer button. Thankyou

Answer 1

Jagan Rajagopal 0

you need to modify the build.yml file in Azure DevOps to specify which pipelines to include in the CI/CD process for Azure Data Factory (ADF). This customization allows you to control which parts of your ADF are deployed, based on your CI/CD requirements . Selective Triggers: You can set up triggers in the YAML file to specify which branches should initiate the CI/CD pipeline. For example, you might want to trigger the pipeline only when changes are made to a specific branch like adf_publish. Pipeline Resources: You can define resources in your YAML file to specify which pipelines to include. This can be done by listing the pipelines you want to trigger under the resources section.

Ksenija Saulic 0 Reputation points

2024-01-15T12:08:53.59+00:00
Hi @Jagan Rajagopal , Could you help me with code structure?
I added this in my build.yml file but now it is failing

resources: pipelines: - pipeline: pl_pipeline1 source: pl_pipeline1 # Replace with the name of your ADF pipeline
Ksenija Saulic 0 Reputation points

2024-01-15T14:18:30.4433333+00:00

Also just to check, I was talking about pipeline in ADF, not pipeline in AzureDevops
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Answer 2

Hi Ksenija Saulic ,

Welcome to Microsoft Q&A platform and thanks for posting your query here.

As per my understanding you want to know if selective publishing or selective deployment is possible in ADF or not .

By design, Data Factory doesn't allow cherry-picking of commits or selective publishing of resources. Publishes will include all changes made in the data factory.

Data factory entities depend on each other. For example, triggers depend on pipelines, and pipelines depend on datasets and other pipelines. Selective publishing of a subset of resources could lead to unexpected behaviors and errors.
On rare occasions when you need selective publishing, consider using a hotfix. For more information, see Hotfix production environment.

Reference documents:
https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/data-factory/continuous-integration-delivery.md

https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/data-factory/continuous-integration-delivery-hotfix-environment.md
https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/data-factory/tutorial-control-flow-portal.md Hope it helps. Kindly accept the answer by clicking on Accept answer button. Thankyou

Share via

How to publish only some pipelines in adf using cicd azure devops

2 answers

Your answer