Azure Databricks Billing

P, John 120 Reputation points
2024-07-08T21:20:19.8566667+00:00

I am confused about how the databricks service is billed under Azure.

  1. From documentation, it is said that Databricks is totally integrated with Azure billing: one bill for both Azure infrastructure (VM, storage, Network traffic, etc) and Databricks DBUs. Our billing manager told there was a separate charge from Databricks, under databricks' own managed resource group.
  2. From Azure Cost Analysis, I saw the charge for service "Azure Databricks". Will this charge be the aggregated cost of using databricks? If so, how can I access the more granulated billing, like per cluster usage?
  3. Which role and Which Resource group do I need to access the detailed Databricks billing information. I don't have access to the databricks managed resource group now. Shall I apply "billing reader" role or "admin" role ?
Azure Cost Management
Azure Cost Management
A Microsoft offering that enables tracking of cloud usage and expenditures for Azure and other cloud providers.
2,331 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,070 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. akinbade abiola 8,450 Reputation points
    2024-07-08T22:36:02.02+00:00

    Hello Pan, John,

    Thanks for your question.

    I will be answering your questions.

    1. Yes, Databricks is integrated with Azure billing. This includes both the Azure infrastructure costs (such as VMs, storage, and network traffic) and Databricks Unit (DBU) costs.
    2. The "Azure Databricks" charge in Cost Analysis is the aggregated cost for your Databricks usage. To access per cluster usage, you need to navigate to the databricks workspace and then the admin console. https://learn.microsoft.com/en-us/azure/databricks/workspace/
    3. You'll need at least the "Billing Reader" role to access billing information as well as admin access to the Databricks workspace to view detailed usage within Databricks. See: https://learn.microsoft.com/en-us/azure/role-based-access-control/overview https://learn.microsoft.com/en-us/azure/role-based-access-control/role-assignments-portal

    You can mark it 'Accept Answer' and 'Upvote' if this helped you

    Regards,

    Abiola

    0 comments No comments

  2. P, John 120 Reputation points
    2024-07-09T16:51:23.1933333+00:00

    Thanks for the prompt response! I am the databricks workspace admin and has Azure billing reader role. Unfortunately I still can not find "admin console" in my workspace's setting page. I chose the Standard SKU when creating the workspace, does it make any difference? I found the following link https://community.databricks.com/t5/data-engineering/unity-catalog-azure-account-console-how-to-access/m-p/32955

    It seems I need more than billing reader role and workspace admin privilege.

    0 comments No comments