Azure Databricks - How to restrict users don't spinup clusters with "L" Series?

Vijay Kumar 2,036 Reputation points
2020-11-23T21:15:49.287+00:00

How to create or change cluster policy (Spark) in Databricks

  1. to restrict users don't spinup clusters with "L" Series?
  2. to restrict users to change from existing series to "L"?
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,259 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA 90,246 Reputation points
    2020-11-24T11:37:30.007+00:00

    Hello @Vijay Kumar ,

    A cluster policy limits the ability to configure clusters based on a set of rules.

    Note: The policy rules limit the attributes or attribute values available for cluster creation. Cluster policies have ACLs that limit their use to a specific users and groups.

    Cluster policies let you:

    • Limit users to create clusters with prescribed settings.
    • Simplify the user interface and enable more users to create their own clusters (by fixing and hiding some values).
    • Control cost by limiting per cluster maximum cost (by setting limits on attributes whose values contribute to hourly price).

    Here is the policy to restrict with "L" Series:

    42194-image.png

    {  
      "node_type_id": {  
        "type": "blacklist",  
        "values": [  
          "Standard_L4s",  
          "Standard_L8s",  
          "Standard_L16s",  
          "Standard_L32s",  
          "Standard_L8s_v2",  
          "Standard_L16s_v2",  
          "Standard_L32s_v2",  
          "Standard_L64s_v2",  
          "Standard_L80s_v2"  
        ]  
      }  
    }  
    

    Here is the policy to allow only with "L" Series.

    42150-image.png

    {  
      "node_type_id": {  
        "type": "whitelist",  
        "values": [  
          "Standard_L4s",  
          "Standard_L8s",  
          "Standard_L16s",  
          "Standard_L32s",  
          "Standard_L8s_v2",  
          "Standard_L16s_v2",  
          "Standard_L32s_v2",  
          "Standard_L64s_v2",  
          "Standard_L80s_v2"  
        ]  
      }  
    }  
    

    Reference: Azure Databricks - Manage cluster polices.

    Hope this helps. Do let us know if you any further queries.

    ------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.