What is 'Azure Databricks Regional' cost subcategory in Azure Cost management?

Question

What is 'Azure Databricks Regional' cost subcategory in Azure Cost management?

Christoph Bergmeister 20 MVP

I could not find any documentation around it or information on Internet. This subcategory only shows for one of many (Premium) Databricks workspaces in a subscription.

Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2023-10-31T19:58:30.8+00:00

Hello

The Azure Databricks Regional cost subcategory in Azure Cost Management refers to the costs associated with running Azure Databricks in a specific region

If you look a the below screenshot, you can see the associated cost for US West 3 on the specific Databricks workspace.

When an Azure Databricks Workspace resource is created, a Managed Resource Group is also created associated with the workspace. This group contains the default storage account, virtual machines for cluster nodes, disks for the nodes, networking resources, etc

When you select "meter subcategory" as Azure Databricks Regional, you won't see the Databricks Managed Resource group and its resources.

If you are seeing the cost subcategory only for one of your premium workspaces then I believe, there is no cost associated with other workspaces in that time frame.

I hope this helps.

Please let me know if you have any further questions.
Christoph Bergmeister 20 Reputation points MVP

2023-11-02T11:07:13.0433333+00:00

Hi, this still doesn't make sense. I have multiple Premium Databricks workspaces in West Europe in this subscription but only one has 'Azure Databricks Regional' cost, which I need to identify where it is coming from.

Therefore it is still not clear what this cost is and where it is coming from. When I filter cost by cluster id, the untagged cost matches exactly up to the cent with the cost of this subcategory. You mention 'costs associated with running Azure Databricks in a specific region', what could this be specifically so we can review and potentially reduce this cost? I also just opened a support request around this with id 2311010030003188 where I provided more details such as workspace and subscription.
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2023-11-03T19:14:11.4466667+00:00

Hello Christoph Bergmeister,

I am checking to see if you got a chance to look into my above response. Please let me know if you have any further questions.

Answer accepted by question author

1 additional answer

Your answer

Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2023-10-31T19:58:30.8+00:00

Hello

The Azure Databricks Regional cost subcategory in Azure Cost Management refers to the costs associated with running Azure Databricks in a specific region

If you look a the below screenshot, you can see the associated cost for US West 3 on the specific Databricks workspace.

When an Azure Databricks Workspace resource is created, a Managed Resource Group is also created associated with the workspace. This group contains the default storage account, virtual machines for cluster nodes, disks for the nodes, networking resources, etc

When you select "meter subcategory" as Azure Databricks Regional, you won't see the Databricks Managed Resource group and its resources.

If you are seeing the cost subcategory only for one of your premium workspaces then I believe, there is no cost associated with other workspaces in that time frame.

I hope this helps.

Please let me know if you have any further questions.
Christoph Bergmeister 20 Reputation points MVP

2023-11-02T11:07:13.0433333+00:00

Hi, this still doesn't make sense. I have multiple Premium Databricks workspaces in West Europe in this subscription but only one has 'Azure Databricks Regional' cost, which I need to identify where it is coming from.

Therefore it is still not clear what this cost is and where it is coming from. When I filter cost by cluster id, the untagged cost matches exactly up to the cent with the cost of this subcategory. You mention 'costs associated with running Azure Databricks in a specific region', what could this be specifically so we can review and potentially reduce this cost? I also just opened a support request around this with id 2311010030003188 where I provided more details such as workspace and subscription.
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2023-11-03T19:14:11.4466667+00:00

Hello Christoph Bergmeister,

I am checking to see if you got a chance to look into my above response. Please let me know if you have any further questions.

Answer 1

Bhargava-MSFT 31,361 Microsoft Employee Moderator

Hello Christoph Bergmeister,

Yes, you are correct. This cost is only associated with the Premium Databricks workspaces region.

When I further filter the cost from my end via the "Meter", I see the cost is associated with:

Premium SQL compute
Premium Serverless SQL (in the premium workspace region)

Please see the below pricing calculator.

for the Standard tier- SQL compute/Serverless SQL/SQL pro compute doesn't apply.

These costs are only applicable to premium tiers.

https://azure.microsoft.com/en-us/pricing/details/databricks/

and from the below document, Some of the features are region-specific only.

For example- in west Europe- Serverless SQL is supported. So you can see the cost related when using these features that appear under" Azure databricks regional" as they are related to region-specific.

https://learn.microsoft.com/en-us/azure/databricks/resources/supported-regions#--supported-regions-list

I hope this makes sense to you. Please let me know if you have any further questions.

User's image

Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2023-11-06T17:45:45.0133333+00:00

Hello Christoph Bergmeister,

I am checking to see if you got a chance to look into my above response.

If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.
Christoph Bergmeister 20 Reputation points MVP

2023-11-06T18:50:51.4333333+00:00

Yes, this helped more than initial comment. It was SQL Compute indeed. Still very confusing name of subcategory and not being able to filter cost by sql datawarehouse instance is poor implementation from the product's side
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2023-11-06T23:34:35.5566667+00:00

Hello Christoph Bergmeister,

Thank you and I agree with you on the feedback.

I will take this up with the product group. Have a good day!

Answer 2

Christoph Bergmeister 20 MVP

(moved to comment)

0 comments

Share via

What is 'Azure Databricks Regional' cost subcategory in Azure Cost management?

1 additional answer

Your answer