how to disable autoscaling local storage

Question

I'm configuring the cluster with the 'enable_elastic_disk' parameter as 'false', using tfvars.

ex: enable_elastic_disk = false.

However, clustering in Databricks remains true.

what to do?

Answer 1

Hi @Coimbra, Diego(GLOBAL-V) ,

Welcome to Microsoft Q&A forum and thanks for reaching out here.

As per your description, my understanding is that even though you are trying to set enable_elastic_disk = false the clustering remains true. Please correct me if my understanding is not accurate.

Seems like your workspace admin had created a Fixed cluster policy for enable_elastic_disk . Which is why even though you have disabled it, it automatically set to true.

Hence would recommend checking with your workspace admin to update the cluster policy for enable_elastic_disk so that you can disable it.

Sample Cluster policy JSON definition looks like below:

Here is how you can check the policies if you already have access else you will have to work with your workspace admin.

Please refer to this document for more details: Manage cluster policies

Hope this info helps.

---

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.