ADF deployment issue

Question

Hi,

I am using Azure data factory and setup different branches for developers. I have setup adf publish branch as well so that when developers are done with their changes, we can publish the changes to adf publish branch and then from that branch I can deploy to Test or Prod env from Azure devops pipeline. There is ARM Template deployment Task in ADO which we are using it. We are using Global paramemeter also so that we can change the parameter as per the environment.

Problem : In the ADF pipeline itself there is an option Parameter which is specifically to that pipeline and that parameter has environment specific function app name.

How can I change it while deploying it to Test Env or QA env with Automation. These cannot be set as Global parameter.

Answer 1

Hello RSingh,

Welcome to the Microsoft Q&A forum

To manage environment-specific parameters in your Azure Data Factory pipelines while automating deployment via Azure DevOps, you can use a combination of parameterization and variable groups.

parameterization:

By defult all artifacts properties are not exposed and parameterized.

Once you integrate your workspace with your Git repository and publish the changes, you will see the below two files.

TemplateForWorkspace.json is the ARM template containing all the workspace artifacts and resources

TemplateParametersForWorkspace.json is the ARM template containing only the artifacts parameters.

TemplateParametersForWorkspace.json file containing a global parameter for your workspace name and a parameter for each workspace default linked service:

for the artifacts properties that are not exposed by default, you will need to create the arm-template-parameters-definition.json under the main root folder and parameterize the artifacts properites.

You can follow the below document for this.

https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-resource-manager-custom-parameters#custom-parameter-syntax

By using the custom template parameter file, you can automate your CICD process in ADF to override any artifact property that is not parameterized by the default parameters template.

Once the values are parameterized then you can directly use them on the relase pipeline on the overrideparametes section.

or you can also use the Variable groups and link the variable groups to the devops pipeline.

You can follow this video tutorial for the variable groups creation and how to use them on the pipeline. (the video is for synapse but the process is same for ADF)

I hope this answers your question. if you have any further questions, please let me know.

If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.