Why there is only "Publish All" option in Azure Data Factory

Question

Hi,

I'm wondering is there any way to save changes for only one pipeline in data factory.

Let's say I have 5 pipelines and I mad some changes in 4 pipelines. But 3 of them giving error and I can't find why. On the otherhand 1 pipeline which I mad some changes is working and I want to publish it.

But when I click de "Publish All" button because of other pipelines errors it's not publising any thing.

Is there any way to publish only one pipeline in data factory.

Best Regards,
Deniz

Answer 1

Hi @Deniz Alkan ,
Thankyou for using Microsoft Q&A platform and thanks for posting your question here.
As I understand your ask, you want to know if there is any way to publish a specific change made in ADF eg. saving only one out of 3 pipelines.

Saving a specific pipeline option is available when you configure a git repository in your ADF. To know more about how to configure GIT, kindly visit Source control in Azure Data Factory . However, while publishing you can't pick a particular change to publish.

Once all the pipelines are fixed in local branch, you can give a pull request to merge the changes to the master branch and then publish your changes. For more details, kindly check Azure Data Factory – Collaborative development of ADF pipelines using Azure DevOps – Git

Attaching video for reference: Here I made changes to Pipeline 1(which I don't want to publish) and also, created a new pipeline which I saved but publishing can't be selective.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Answer 2

Connect it to devops git. You can develop your changes in separate branches, test them without publishing, and then only publish the ones you want after merging to main.
The only exception is linked services (I think that is all), as they immediately get published once you create them.

Answer 3

Hey,
Based on my understanding there is no direct way to publish specific changes only.

What you can do is open a new tab for the same ADF and override/Copy the JSON of the pipeline you want to change and publish it.

That way you can publish it and also reatin other changes in other tab

Answer 4

Hi,

Thank you for your answer @Nandan Hegde . I'm just looking more useful way. Do you have any suggestion @AnnuKumari-MSFT