Azure Databricks Cluster Policy

Question

Azure Databricks Cluster Policy

Ujwal Dasari 1

When I am changing policy on a cluster. What implications will I have on the other clusters running on the policy? What are the best practices to follow?

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-06-20T07:14:41.103+00:00
Hello @Ujwal Dasari ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

1 answer

Your answer

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-06-20T07:14:41.103+00:00

Hello @Ujwal Dasari ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

Answer 1

PRADEEPCHEEKATLA 90,641 Moderator

Hello @Ujwal Dasari ,

Thanks for the question and using MS Q&A platform.

If you are changing policy on a cluster - it will be applicable for the cluster which you have chosen and it will no impact the other clusters.

Example: I had a policy created with name "DBR:10.4" which is only applicable to the cluster named "chepra-10.4" and it will no impact the other clusters named "chepra-9.1" or "chepra-9.0" because it doesn't use any policy.

For more details, refer to Best practices: Cluster policies.

Hope this will help. Please let us know if any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Ujwal Dasari 1 Reputation point

2022-06-16T13:53:49.977+00:00

Yes, correct. But what if I am using the same policy for multiple clusters? What would the implications be then? How would it affect the already existing clusters or any newly created clusters using the same policy?
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-06-17T06:05:31.807+00:00

Hello @Ujwal Dasari ,

If you apply the same policy for the multiple clusters. Then the policy enforces to the cluster which you have selected.

Example: I had a policy created with name "DBR:10.4" which is a policy which enforces to create a cluster with DBR:10.4 LTS (includes Apache Spark 3.2.1, Scala 2.12) version. If I apply the policy to the cluster which having the DBR: 9.1 it changes to DBR:10.4 as per the policy enforced.

Hope this will help. Please let us know if any further queries.

Share via

Azure Databricks Cluster Policy

1 answer

Your answer