Azure Databricks Cluster creation

Question

Banavath Tarun 1

I had created Databricks workspace but the cluster is always taking more time to load and finally terminating either with the error massage

"Bootstrap Timeout:
Timeout after 600 seconds while setting up launched instance c84aa4bcf54e41c78ce9b3d25f9738d4."
(or)
Azure Vm Extension Failure:
Instance bootstrap failed. Failure message: Cloud Provider Failure. Azure VM Extension stuck on transitioning state. Please try again later. VM extension code: ProvisioningState/transitioning instanceId: InstanceId(9c03e6664e92457fa8d3e774da0066c6) workerEnv: workerenv-190918737783909 Additional details (may be truncated): Enable in progress.

Can anyone help me on this.
thank you.

PRADEEPCHEEKATLA 90,661 Reputation points Moderator

2022-11-15T05:21:48.713+00:00
Hello @Banavath Tarun ,

Thanks for the question and using MS Q&A platform.

This could happen if there is scheduled maintainance update on the Azure Databricks. I would suggest you to re-create and see if that works.

In case, if you are still exeriencing the same issue - I would request you to share the below details:

Azure Databricks Workspace region?

What time did the problem begin?

Have you tried to create a new workspace with different runtime & VM size?
Banavath Tarun 1 Reputation point

2022-11-16T11:40:24.35+00:00

Sure, will try re-creating the databricks.
PRADEEPCHEEKATLA 90,661 Reputation points Moderator

2022-11-17T10:00:08.097+00:00

Hello @Banavath Tarun ,

Did you get a chance to re-create and does it work as excepted?
PRADEEPCHEEKATLA 90,661 Reputation points Moderator

2022-11-21T08:17:19.043+00:00

Hello @Banavath Tarun ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond with more details and we will try to help.

1 answer

PRADEEPCHEEKATLA 90,661 Reputation points Moderator

2022-11-15T05:21:48.713+00:00

Hello @Banavath Tarun ,

Thanks for the question and using MS Q&A platform.

This could happen if there is scheduled maintainance update on the Azure Databricks. I would suggest you to re-create and see if that works.

In case, if you are still exeriencing the same issue - I would request you to share the below details:

Azure Databricks Workspace region?

What time did the problem begin?

Have you tried to create a new workspace with different runtime & VM size?
Banavath Tarun 1 Reputation point

2022-11-16T11:40:24.35+00:00

Sure, will try re-creating the databricks.
PRADEEPCHEEKATLA 90,661 Reputation points Moderator

2022-11-17T10:00:08.097+00:00

Hello @Banavath Tarun ,

Did you get a chance to re-create and does it work as excepted?
PRADEEPCHEEKATLA 90,661 Reputation points Moderator

2022-11-21T08:17:19.043+00:00

Hello @Banavath Tarun ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond with more details and we will try to help.

Answer 1

Gopinath Rajee 656

We had the exact same issue in our Stage environment. Microsoft udrrecommended us to follow this link.

"Since the issue is with interactive cluster, I suggest you check the UDR's and add all the route tables into the custom DNS and run it"

This suggestion seems to have helped since we are not seeing this error for the last three days.

Amit Shokeen 0 Reputation points

2024-12-04T22:14:44.8066667+00:00

This is the perfect answer, I have a similar issue where bootstrap is getting timeout, further digging into I found UDR tags were missing and the firewall is blocking UDP port 53 traffic towards our DNS server. once the rule is in the firewall and UDR. everything is sorted out :) cheers.