Share via

databricks cluster init script

Vinodh247 40,051 Reputation points MVP Volunteer Moderator
2022-09-29T05:14:13.69+00:00

Can I schedule a init script to a azure databricks cluster and have it reflected in all the clusters that it scales up in the process? How can i determine the default cluster where my init script has to be scheduled?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator
    2022-09-30T09:25:09.583+00:00

    Hi @Vinodh247 ,

    Thank you for posting query in Microsoft Q&A Platform.

    You can consider configuring Global Init Scripts. So that it reflects on all clusters.

    246424-image.png

    Not only global level, we can also configure init scripts at cluster level as well. Kindly check below detailed documentation for init scripts configuration.
    Cluster node initialization scripts

    Hope this helps. Please let me know if any queries.

    --------------

    Please consider hitting Accept Answer and Up-Vote buttons. Accepted answers help community as well.

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.