What does publishing do in Azure Data Factory do?

Siddhanth Shetty 66 Reputation points
2020-09-19T15:02:01.35+00:00

What does publishing a pipeline/dataset in data factory do? Does it publish the data somewhere where other users can access? Is it related to publishing a Power BI notebook?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,640 questions
0 comments No comments
{count} votes

Accepted answer
  1. HarithaMaddi-MSFT 10,146 Reputation points
    2020-09-21T09:41:20.323+00:00

    Hi @Siddhanth Shetty ,

    Welcome to Microsoft Q&A Platform. Thanks for posting the query.

    • When data factory is not connected to any repository, it is said to operate in Live mode. In this mode, if you don't publish the changes, those will be lost once you close the session. It is essentially same as "Save" option.
    • When data factory is connected to GIT/ADO repository, it is said to operate in GIT mode and is recommended mode by Azure Data Factory(ADF) as it helps in automating the deployments and customize the deployments in various environments using release pipelines and parameters. In this mode, publish option will work from branch designated as "Collaboration branch" while setting up GIT mode in ADF and this will create a branch "adf_publish" that will store consolidated ARM templates which can be used for automating the deployment of ADF. This MS documentation helps explain all these details.
    • It is slightly similar to PowerBI in GIT mode as it pushes the changes to a branch in repository and that can be browsed by anyone having access to repository.

    Hope this clarifies the query. Please let us know for additional details and we will be glad to assist further.

    3 people found this answer helpful.
    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. Ragunathan Ramanujam 6 Reputation points
    2020-09-20T19:31:49.833+00:00

    Hi,

    Publishing is basically storing your Pipeline. Unfortunately until the completion of validation successful your pipeline is not stored this including your data flows and any additional windows opened to set the parameters for Source and Sink.

    1 person found this answer helpful.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.