Can we setup mannual approval in Azure Datafactory

Vikrant Vikrant 0

I have setup a Data pipeline in Azure data factory for my staging Env. now i want to increase it's task.
After deploying on staging Env i want it should also deploy new changes in my production Env but i want a mannual approval to start deployment on production env. in Azure data factory as we do in Azure devops pipeline

Prrudram-MSFT 23,211 Reputation points

2023-05-15T11:32:35.2666667+00:00
Hi @Vikrant Vikrant

You can use Azure DevOps to create a release pipeline that deploys your Data Factory artifacts to multiple environments, including staging and production. You can configure the release pipeline to require manual approval before deploying to production.

To set up a release pipeline in Azure DevOps, follow these steps:

Create a new release pipeline in Azure DevOps.

Add an Azure Data Factory artifact to the release pipeline.

Add a stage for each environment you want to deploy to, such as staging and production.

Configure the deployment settings for each stage, such as the target Data Factory and the ARM template to deploy.

Add a pre-deployment approval gate to the production stage.

Configure the approval settings, such as who needs to approve the deployment and how they will be notified.

Save and run the release pipeline.

When the release pipeline runs, it will deploy your Data Factory artifacts to the staging environment automatically. Once the staging deployment is complete, the release pipeline will wait for manual approval before deploying to the production environment. Once the approval is granted, the release pipeline will deploy the changes to the production environment.

For more information on how to set up a release pipeline in Azure DevOps, see the official documentation.
Vikrant Vikrant 0 Reputation points

2023-05-15T12:30:30.2566667+00:00

Hello @Prrudram-MSFT

My azure data factory does not generate any type of artifacts it simply execute some Azure databrick notebook it get trigger if any new files come to my blob storage account.
Prrudram-MSFT 23,211 Reputation points

2023-05-19T05:54:33.9233333+00:00

Hello Vikrant Vikrant

So, you have set up an Azure Data Factory pipeline to execute an Azure Databricks notebook when new files are added to your blob storage account. However, you mentioned that the pipeline is not generating any artifacts.

When you say "artifacts", are you referring to the output generated by the Azure Databricks notebook? If so, please make sure that the notebook is configured to output the results to a location that can be accessed by the Azure Data Factory pipeline.

You can also check the pipeline's activity runs to see if there are any errors or warnings that might be preventing the pipeline from generating the expected output. To do this, go to the Azure Data Factory portal and navigate to the pipeline's Monitoring tab. From there, you can view the activity runs and any associated errors or warnings.

If you are still having trouble, I would suggest reaching out to support team over a technical support request. and provide them with more details about the pipeline and the Azure Databricks notebook, and support team can try to provide more specific guidance.
AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-05-22T04:43:27.09+00:00

Hi Vikrant Vikrant ,

Just checking in to see if the below answer helped. Please do consider clicking Accept Answer as accepted answers help community as well. Also, please click on Yes for the survey 'Was the answer helpful'
PRADEEPCHEEKATLA-MSFT 85,586 Reputation points Microsoft Employee

2023-05-28T14:37:24.56+00:00

@Vikrant Vikrant - We received your feedback that the answer provided on the thread was not helpful.

Kindly let us know what we could have done better to improve the answer and make your engagement experience good. We are here to help you and strive to make your experience better and greatly value your feedback.

Our engineer have provided a detailed answer which has clear steps for which you are looking for. If you wish, you may re-surveying/rating for the engagement you received on the thread. Your feedback is very important to us.

Looking forward to you reply. Much appreciate your feedback!

Regards,

PRADEEPCHEEKATLA-MSFT

1 answer

AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-05-19T06:52:30.3766667+00:00

Hi Vikrant Vikrant ,

Thankyou for your query on Microsoft Q&A platform .

As I understand, you are trying to deploy your ADF pipeline to prod environment and before deployment you want to have approval process so that the authorized person can approve or reject the deployment request to prod after validation. Please let me know if that is not the ask here.

In addition to Prrudram-MSFT 's suggestion, I would like to add few points . First of all, you can't directly deploy from stage to Prod since stage env won't be connected to GIT. It's only Dev env which should be connected to Git repository and the ARM template of Dev should be deployed to all the higher environments like UAT, Stage and Prod.

Once the Dev env is configured with Git , it publishes the ARM template to the adf_publish branch , the same json is pushed to higher env. So, when you create the release pipeline , it creates the artifact for deployment.

Coming to pre-deployment approval, you can add the DLs of the authorized person such as manager or lead to request for approvals under 'pre-deployment approvals' option:

For more details, kindly watch out the following video: Continuous integration and delivery in azure data factory | CI/CD in ADF

Kindly accept the answer by clicking on Accept answer button if it is helpful. Thankyou
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Share via

Can we setup mannual approval in Azure Datafactory

1 answer