Databricks cluster stuck when trying to start in state of "Finding instances for new nodes"

Daniel Woodhouse 0 Reputation points
2024-08-19T19:39:19.42+00:00

Yesterday I had an issue with multiple notebooks attempting to run against an interactive cluster that they trigger to start but unfortunately the cluster stays in a spinning state saying it is "Finding instances for new nodes"... I even tried terminating the cluster such that new notebooks would subsequently restart the cluster and same thing happened again and again until I cancelled all the notebooks and waited 5 minutes and then manually restarted.

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,212 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.