Connecting to an existing Databricks Cluster in AMLS

Alexander Pakakis 46 Reputation points
2022-06-07T15:04:27.93+00:00

Hello,

we have also found this example of using Databricks as a Compute Target for an Azure Machine Learning Pipeline.

However, we want to use an existing Databricks Cluster as compute target within Azure Machine Learning Studio for our Azure Machine Learning Pipeline.
Could you help us in accomplishing this, please?

With best regards
Alex

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,214 questions
Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
1,647 questions
No comments
{count} votes

Accepted answer
  1. romungi-MSFT 27,196 Reputation points Microsoft Employee
    2022-06-08T05:07:31.167+00:00

    @AlexanderPakakis-0994 Are you looking at adding the cluster from the UI of ML studio rather than using the SDK as mentioned in the notebook you referenced?
    If Yes, you need to add the same attached compute.

    209283-image.png

    Once you select Azure Databricks the following option to add the existing databricks workspace is seen.

    209260-image.png

    I hope this helps!!

    If an answer is helpful, please click on 130616-image.png or upvote 130671-image.png which might help other community members reading this thread.


0 additional answers

Sort by: Most helpful