Azure Databricks: make the parameters dynamic in dbutils.fs.mount

Question

Azure Databricks: make the parameters dynamic in dbutils.fs.mount

Alexis Kan 21

Hi, is it possible to make the parameter <storage-account-name> in dbutils.fs.mount() dynamic? The <storage-account-name> is different between different environment so it would be good to make this parameter dynamic.

AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator

2022-12-12T09:09:44.267+00:00

Hi @Alexis Kan ,
Just checking in to see if the below answer helped. Please do consider clicking Accept Answer and Up-Vote for the same as accepted answers help community as well. If you have any further query do let us know.

1 answer

Your answer

AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator

2022-12-12T09:09:44.267+00:00

Hi @Alexis Kan ,
Just checking in to see if the below answer helped. Please do consider clicking Accept Answer and Up-Vote for the same as accepted answers help community as well. If you have any further query do let us know.

Answer 1

ShaikMaheer-MSFT 38,546 Microsoft Employee Moderator

Hi @Alexis Kan ,

Thank you for posting query in Microsoft Q&A Platform.

Yes you can create a parameter in notebook to take storage account name dynamically and create a mount point from it. Please check below screenshot.

Check below video to know about creating parameters in azure databricks notebook.
Widgets utility(dbutils.widgets) of Databricks Utilities in Azure Databricks | Create parameters in notebook

Check below video to pass values to notebook parameters from another notebook.
Pass values to notebook parameters from another notebook using run command in Azure Databricks

Hope this helps. Please let me know if any further queries.

--------------------

Please consider hitting Accept Answer button. Accepted answers help community as well.

Alexis Kan 21 Reputation points

2022-12-06T16:26:59.41+00:00

Hi @ShaikMaheer-MSFT , thanks for the screenshot. Do you know if it is possible for databricks to determine which environment (prod or dev )it is in? I was thinking if it could that info to select the correct storage account name. I am asking this because if I run a CICD pipeline, databricks will first run in dev and then in prod. The resource group in respectively has a different name.
ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator

2022-12-07T06:12:21.037+00:00
Hi @Alexis Kan ,

You mean to say getting workspace details inside notebook? not exactly workspace name but workspace ID we can get it by running below code.

spark.conf.get('spark.databricks.clusterUsageTags.clusterOwnerOrgId')

Hope this helps.

-----------

Please consider hitting Accept Answer button. Accepted answers help community as well.
ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator

2022-12-22T09:55:18.257+00:00

Hi @Alexis Kan ,

Just checking in to see if the above answer helped. If this answers your query, do click and upvote for the same. And, if you have any further query do let us know.

Share via

Azure Databricks: make the parameters dynamic in dbutils.fs.mount

1 answer

Your answer