Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Trigger Azure VM scripts via Azure Databricks workflow
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 66%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EO%3C/text%3E%3C/svg%3E)
optal13
0
Reputation points
Hello everyone, I have some scripts in Azure Virtual Machine that can only be executed there. And I want to be able to trigger this AVM scripts some by an Azure Databricks workflow. Giving some input variables and receiving some outputs.
I followed this steps, https://learn.microsoft.com/en-us/azure/databricks/administration-guide/cloud-configurations/azure/vnet-inject , creating a AVM and a Databricks Workspace under the same VNetwork. Then, I tried to connect to the AVM via ssh.
However, I am not able to connect to do that last step to trigger the script. Is that even possible?
Any thoughts about it would be appreciated. Thanks and merry christmas!
Azure Databricks
{count} votes
-
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator2023-12-28T06:26:24.92+00:00 Hi optal13,
Thank you for posting query in Microsoft Q&A Platform.
Could you please share more details, such as what steps exactly you performed, where exactly you struck and any error if you facing then error details?
-
optal13 0 Reputation points
2023-12-28T09:02:26.84+00:00 Yes. I am not able to connect to the AVM. Neither from databricks or other machine (my local machine).
Steps:
a) Created a AVM and a databricks workspace under the same Virtual Network.
b) AVM / Settings / Networking: Add inbound port rules for 22 network.
c) Trying to connect using the ssh (using a databricks notebook - the objective - or my local machine). No one is working.
ERROR:
When I try to connect :ssh -i <ssh keypath> username@public_ip-->debug1: connect to address <public_ip> port 22: Operation timed outThats the nets from the AVM
Also, tried to connect using other commands like:
az login->az shh -g <my_rgroup> --local-user <mylocaluser>-->Operation timed outAlso using the DNS name, it doesn't work neither.
-
Luis Arias 9,481 Reputation points Volunteer Moderator2024-01-17T19:23:30.9966667+00:00 Hi , If you are already created the Databricks Workspace with vnet integration yo need to use the private IP address to connect:
In your databricks job you will need to use : %sh You can execute the test from another VM inside the same vnet using the private ip:
ssh -i <ssh keypath> username@private_ip.On the other hand if also you want to enable the SSH from you local machine you need to modify you SSH rule. I understood that your public ip is 20.160.235.117. Isn't it? Let me know if this information help you. Cheers Luis
Sign in to comment
Sign in to answer