export DATABRICKS_HOST is not working with Databricks cli

Bhanu Anjaneya Swami Muddhana 21

Hello Team, I am trying to automate to manage Azure Databricks work spaces like add and remove users ( Need to manage several workspace).

I have setup environment variables like below

token_response=$(az account get-access-token --resource 2ff814a6-3304-4ab8-85cb-cd0e6f879c1d)
export DATABRICKS_AAD_TOKEN=$(jq .accessToken -r <<< "$token_response")
export DATABRICKS_HOST='my workspace url'

When I am trying to run databricks configure --aad-token

asking working workspace url

Databricks Host (should begin with https://):

Not taking from Environment variables.

I am using latest version of databricks cli. I even tried with pervious versions.

Any suggestions.

PRADEEPCHEEKATLA 90,351 Reputation points

2023-05-05T06:40:14.77+00:00

@Bhanu Anjaneya Swami Muddhana - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

PRADEEPCHEEKATLA 90,351 Reputation points

2023-05-02T05:37:50.38+00:00

@Bhanu Anjaneya Swami Muddhana - Thanks for the question and using MS Q&A platform.

Did you creates a file named .databrickscfg in your ~ (your user home) folder on Unix, Linux, or macOS, or your %USERPROFILE% (your user home) folder on Windows, if this file does not already exist.

Note: For first time, you need to pass the values manually or create this file named .databrickscfg in your ~ (your user home) to set as environment variables.

This article Databricks CLI provides an easy-to-use interface to automate the Azure Databricks platform from your terminal, command prompt, or automation scripts.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
Bhanu Anjaneya Swami Muddhana 21 Reputation points

2023-05-02T16:55:25.4633333+00:00

@PRADEEPCHEEKATLA , Thanks for the response.

Yes, I have .databrickscfg file.

cat ~/.databrickscfg

[DEFAULT]

host = https://xxxxxxx.18.azuredatabricks.net

token = "TOKEN VALUE"

jobs-api-version = 2.0

again if run databricks configure --aad-token

asking mr HOST url runtime

Databricks Host (should begin with https://):

Also I am following the Databricks CLI for environment variables to automate the process because I have multiple workspaces

DATABRICKS_HOST

DATABRICKS_TOKEN

But when I run databricks configure --aad-token it is only taking DATABRICKS_TOKEN not DATABRICKS_HOST._

if I do echo $DATABRICKS_HOST its giving me my workspace url.

Any suggestions !

PRADEEPCHEEKATLA 90,351 Reputation points

2023-05-03T06:57:28.8566667+00:00

@bhanu m - Once you have configured the host and the token - you need not to congfigure again.

In case, if you want to replace the value - you can reconfigure again.

As per the repro, I had configured three profiles:

Default

annu

bhargava

Which you can find in the file named .databrickscfg

And able to use the databricks cli commands for three profiles created as shown:

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Bhanu Anjaneya Swami Muddhana 21 Reputation points

2023-05-03T20:13:30.5666667+00:00

@PRADEEPCHEEKATLA , Thanks again for the respone.

Once I configure the host it is asking me again and again. I even tried from Azure cloud shell I am getting same behavior.

my main goal is to automate the process. I want to get our workspace url's as runtime parameter. So if I can set environment variable export DATABRICKS_HOST = $mydatarbrickurl.

so I can databricks configure --aad-token without prompting for databricks url.

but in this case databricks configure is not taking value from environment variable DATABICKS_HOST.

Let me know if missing any anything.

Thanks

PRADEEPCHEEKATLA 90,351 Reputation points

2023-05-04T04:22:14.06+00:00

@bhanu m - Can you please share the file named .databrickscfgwhich you have configured?

And what happen when you run databricks fs ls dbfs:/ --profile somename ?

Please do add the screenshot for the questions?

Bhanu Anjaneya Swami Muddhana 21 Reputation points

2023-05-05T21:39:14.63+00:00

@PRADEEPCHEEKATLA , Please find the screen shots

PRADEEPCHEEKATLA 90,351 Reputation points

2023-05-08T03:40:36.7033333+00:00

@bhanu m - Please do share what is inside the .databrickscfgwhich you have configured?

Same like the below screenshot:

PRADEEPCHEEKATLA 90,351 Reputation points

2023-05-10T07:58:15.62+00:00

@bhanu m - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Bhanu Anjaneya Swami Muddhana 21 Reputation points

2023-05-23T21:48:50.5566667+00:00

@PRADEEPCHEEKATLA

Please find the below

PRADEEPCHEEKATLA 90,351 Reputation points

2023-05-29T07:16:32+00:00

@bhanu m - I agree that this issue looks strange and I wasn't able to reproduce this issue. If you have a support plan could you please file a support ticket for deeper investigation and do share the SR# with us?
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

export DATABRICKS_HOST is not working with Databricks cli

1 answer

Your answer