How to execute java command on Azure Virtual Machine from Azure Data Factory

satya 0

I have executable fat jar deployed on Azure Virtual Machine (LINUX). I want to run this jar using java command from Azure Data Factory. Basically, I want to create a pipeline to call several java commands, one at a time in pipeline. I tried to create linked service in ADF but I couldnt see Virtual Machine in the list.

Please note that I dont want to convert this into web based Spring boot, or Azure Function or compute. I want to keep the jar within Azure Virtual Machine.

Can you please send me step by step instructions.

PRADEEPCHEEKATLA-MSFT 89,291 Reputation points Microsoft Employee

2024-03-21T04:22:03.8966667+00:00

@satya - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

PRADEEPCHEEKATLA-MSFT 89,291 Reputation points Microsoft Employee

2024-03-19T06:39:13.46+00:00
@satya - Thanks for the question and using MS Q&A paltform.

Unfortunately, Azure Data Factory does not support executing commands on Azure Virtual Machines directly.

This is an official document which shows the supported data sources in Azure data factory.

However, you can use Azure Automation to run PowerShell scripts on your Azure Virtual Machine.

Here are the high-level steps to achieve this:

Create an Azure Automation account.

Create a PowerShell runbook in Azure Automation.

Add the necessary code to the runbook to execute the Java command on your Azure Virtual Machine.

Create a webhook for the runbook.

Use the webhook URL in Azure Data Factory to trigger the runbook.

For more details, refer to Start a runbook from a webhook and How to configure Webhook activity for runbooks execution in Azure Data Factory v2?.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
satya 0 Reputation points

2024-03-20T04:55:33.0966667+00:00

Thank you so much for the response. Can you please help me with point 3 above on how to connect to a particular VM ? I didnt understand how to link VM from powershell in Runbook. Can you please send me any relevant links or instructions.

PRADEEPCHEEKATLA-MSFT 89,291 Reputation points Microsoft Employee

2024-03-20T05:38:15.7666667+00:00

@satya - Add the necessary code to the runbook to execute the Java command on your Azure Virtual Machine:

In the runbook editor, add the following code to execute the Java command on your Azure Virtual Machine:

$username = "username" $password = ConvertTo-SecureString "password" -AsPlainText -Force $credential = New-Object System.Management.Automation.PSCredential($username, $password) $session = New-PSSession -ComputerName "vmname" -Credential $credential Invoke-Command -Session $session -ScriptBlock { java -jar /path/to/jar } Remove-PSSession -Session $session

Replace "username" and "password" with the credentials for your Azure Virtual Machine, "vmname" with the name of your Azure Virtual Machine, and "/path/to/jar" with the path to your executable fat jar on the Azure Virtual Machine.

Hope this helps. Do let us know if you any further queries.

satya 0 Reputation points

2024-03-26T14:22:19.74+00:00

The WinRM client cannot process the request. If the authentication scheme is different from Kerberos, or if the client computer is not joined to a domain, then HTTPS transport must be used or the destination machine must be added to the TrustedHosts configuration setting. Use winrm.cmd to configure TrustedHosts. Note that computers in the TrustedHosts list might not be authenticated. You can get more information about that by running the following command: winrm help config. For more information, see the about_Remote_Troubleshooting Help topic. System.Management.Automation.ParameterBindingValidationException: Cannot validate argument on parameter 'Session'. The argument is null or empty. Provide an argument that is not null or empty, and then try the command again. ---> System.Management.Automation.ValidationMetadataException: The argument is null or empty. Provide an argument that is not null or empty, and then try the command again.

satya 0 Reputation points

2024-03-26T14:22:49.2266667+00:00

I am having issues when I run script from run book. I am not able to find where to add the computer name/IP address to trusted host as per this error message. Can you please help. This is the error message.

PRADEEPCHEEKATLA-MSFT 89,291 Reputation points Microsoft Employee

2024-03-27T08:09:13.1066667+00:00

@satya - The scope of your question is different compared to the original scope of the question asked.

I would recommend creating a new thread on the Azure Automation forum with as much details about your issue as possible. That would make sure that your issue has better visibility in the community.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How to execute java command on Azure Virtual Machine from Azure Data Factory

1 answer

Your answer