Invoking ADF pipeline from an Azure vm

Question

Invoking ADF pipeline from an Azure vm

pmscorca 1,032

Hi, is it possible to invoke a Data Factory pipeline from an Azure vm by a scheduled command, f.e. a file .bat? Thanks

Harishga 5,995 Reputation points Microsoft External Staff

2024-02-13T03:33:40.5433333+00:00

@pmscorca
Just checking in to see if the below answer provided by @ Sedat SALMANhelped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

Harishga 5,995 Reputation points Microsoft External Staff

2024-02-13T03:33:40.5433333+00:00

@pmscorca
Just checking in to see if the below answer provided by @ Sedat SALMANhelped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

Sedat SALMAN 14,155 MVP

I may try to give a step-by-step procedure

first, install azure cli on your Azure VM
you can use it to create and run ADF pipelines
1. az datafactory pipeline create
2. az datafactory pipeline create-run

For scheduled automation, place the Azure CLI commands within a .bat file and use Windows Task Scheduler to execute this file at your chosen times.

Harishga 5,995 Reputation points Microsoft External Staff

2024-02-12T10:03:35.3366667+00:00

pmscorca
Just checking in to see if the above answer provided by @ Sedat SALMAN helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
pmscorca 1,032 Reputation points

2024-02-14T19:13:23.5633333+00:00

Hi, with which user is it possible "az datafactory pipeline create-run" command inside the file .bat to launch by a scheduled Windows taks?
Where it occurs indicating this user? As a parameter for the az command? The pipeline to launch is existing and I don't need to create it.
Harishga 5,995 Reputation points Microsoft External Staff

2024-02-15T09:45:17.3633333+00:00

pmscorca
When you run the az datafactory pipeline create-run command inside a .bat file to launch a scheduled Windows task, the user context in which the command is executed depends on how the task is set up. By default, the task runs under the security context of the user account that created the task. So, if you create the task using your user account, the command will be executed under your user context.

In case you want to set up the task to run under a different user account, you can specify the user account and password when creating the task using the Windows Task Scheduler. When the task runs, it will execute under the security context of the specified user account.

To specify the user account and password as parameters for the az datafactory pipeline create-run command, you can use some specific parameters to authenticate with Azure Active Directory and specify the credentials for the service principal that has permission to run the pipeline.

I hope this information helps you. Let me know if you have any further questions or concerns.

Share via

Invoking ADF pipeline from an Azure vm

1 answer

Your answer