Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
2 answers
Databricks network connectivity
For both private and public subnet, the virtual network traffic and internet traffic is routed to Azure firewall. So what are the Azure firewall rules required for the databricks workspace to work correctly Also should there be rules for connectivity…
Azure Databricks
asked 2026-05-21T09:50:26.2666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 50%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAN%3C/text%3E%3C/svg%3E)
Anushree N
40
Reputation points
answered 2026-05-22T14:15:29.99+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 2%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Manoj Kumar Boyini
14,900
Reputation points Microsoft External Staff
Moderator
1 answer
can not run cluster due to limit exhausted
while creating databricks resource in azure i have selected the 15 days free trial, does that causing an issue while creating and running notebooks though a job compute cluster
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-22T06:21:03.3033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 26%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKR%3C/text%3E%3C/svg%3E)
kupendar reddy
0
Reputation points
answered 2026-05-22T06:21:17.9433333+00:00
AI answer
0 answers
Unable to create databricks workspace
I am getting the error attached in the the image "quota exceeded" whenever I am trying to create a databricks workspace in my resource group even though I have deleted my previous databricks workspace, I suspect it is still consuming some quota…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-20T16:29:52.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 0%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
Srishti Ahlawat
0
Reputation points Microsoft Employee
commented 2026-05-22T05:08:17.58+00:00
Srishti Ahlawat
0
Reputation points Microsoft Employee
1 answer
Azure Databricks CI/CD Pipeline using Databricks Asset Bundles (DAB) + Azure DevOps — Branching Strategy & Deployment Flow
We have Dev and Prod Environment only Problem Statement: I am setting up a CI/CD pipeline for Azure Databricks using Databricks Asset Bundles (DAB) and Azure DevOps Pipelines. I have created the bundle locally and pushed it to a feature branch…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-21T18:17:27.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 70%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESN%3C/text%3E%3C/svg%3E)
Shubhangi Nannware
120
Reputation points
edited the question 2026-05-21T18:20:19.51+00:00
Shubhangi Nannware
120
Reputation points
1 answer
Enable Anthropic (Claude) models for Azure Databricks Foundation Model APIs / Mosaic AI Model Serving
Can't see Anthropic models in Databricks workspace set in West Europe in our new Azure tenant. We have another older tenant with similar configuration that has Anthropic models available but in this tenant they are missing. How to enable them?
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 33%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EF%3C/text%3E%3C/svg%3E)
3 answers
Batch Cross-Tenant Azure SQL Database Synchronization Using Azure Databricks
We would like to confirm whether the following approaches are supported and recommended: Timestamp/Watermark-based incremental loads using columns such as LastModifiedDate ID-based incremental loads using increasing primary key values Our planned…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-19T04:22:33.7466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 43%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
Mallikarjun appani
6
Reputation points
answered 2026-05-21T06:42:14.5333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 24%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Pilladi Padma Sai Manisha
8,150
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Guidance on Managed Identity Approach for ADLS Gen2
Currently, we are using a single Managed Identity for accessing one storage account in our Databricks Unity Catalog setup. As part of our new governance model, we are creating multiple containers within the same storage account, with separate External…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-21T04:03:42.2+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 82%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVP%3C/text%3E%3C/svg%3E)
Vijay Patel
20
Reputation points
accepted 2026-05-21T04:09:07.0033333+00:00
Vijay Patel
20
Reputation points
1 answer
Azure Databricks workspace stuck in Deleting state; managed resource group still contains resources
My Azure Databricks workspace is stuck in the Deleting state and cannot be deleted again from the Azure Portal or Azure CLI. Workspace details: [Redacted PII Information] Issue: The workspace has been stuck in the “Deleting” state for a long time. The…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-16T16:10:09.6666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 28.000000000000004%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Shubham Gandhi
0
Reputation points
commented 2026-05-20T17:30:05.7966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
35,125
Reputation points Microsoft External Staff
Moderator
4 answers
"How can i optimize a 5 TB daily ETL workload in Azure Databricks orchestrated through Azure Data Factory?"
How can I optimize a 5 TB daily ETL workload in Azure Databricks orchestrated through Azure Data Factory? Please include specific recommendations for cluster sizing, partitioning strategy, Delta Lake optimization, incremental loading, file compaction,…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-17T06:25:04.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 49%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Arpit Shukla
21
Reputation points
commented 2026-05-20T03:51:34.68+00:00
Pilladi Padma Sai Manisha
8,150
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Unable to run remediation or install VM Extension
I have owner access on the root level of an Azure tenant and am trying to run a remediation for 3 Virtual machines. When it was failing, I tried to install the extension directly but received the error: …
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-13T19:50:50.4966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 85%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAB%3C/text%3E%3C/svg%3E)
Admin - BL
20
Reputation points
accepted 2026-05-19T15:10:56.4433333+00:00
Admin - BL
20
Reputation points
4 answers
One of the answers was accepted by the question author.
Does the On-premises data gateway(personal mode) support azure databricks connection
Hi there, Does the On-premises data gateway(personal mode) support azure databricks connection Best regards, zmsoft
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 53%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZ%3C/text%3E%3C/svg%3E)
2 answers
Continuous Cross-Tenant Azure SQL Database Synchronization Using Azure Databricks
Dear Microsoft Support Team, We are working on a requirement to implement a continuous data synchronization pipeline between two Azure SQL Database environments hosted in different Microsoft Entra tenants using Azure Databricks. Requirement Overivew: We…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-18T09:50:56.9866667+00:00
Mallikarjun appani
6
Reputation points
commented 2026-05-19T04:00:44.7466667+00:00
Mallikarjun appani
6
Reputation points
2 answers
Not Able to create cluster
Please find follow error i am seeing. Details for the latest failure: Error: The VM size you are specifying is not available. [details] QuotaExceeded: Operation could not be completed as it results in exceeding approved Total Regional Cores quota.…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-16T08:36:07.5866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 28.000000000000004%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Aman Darash
0
Reputation points
edited an answer 2026-05-18T23:49:02.82+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(208, 49%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESJ%3C/text%3E%3C/svg%3E)
SAI JAGADEESH KUDIPUDI
3,205
Reputation points Microsoft External Staff
Moderator
2 answers
Compute cluster issue
Sorry, cannot run Cluster because you've exhausted your available credits. Please add a payment method to upgrade your account.
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-16T21:05:52.0933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 41%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWS%3C/text%3E%3C/svg%3E)
Wajid Syed
0
Reputation points
commented 2026-05-18T19:09:46.3266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 68%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBY%3C/text%3E%3C/svg%3E)
Bharath Y P
9,010
Reputation points Microsoft External Staff
Moderator
3 answers
unable to create a new compute cluster in Azure databricks.
I want to create a new compute cluster in Azure databricks. But when i click on the compute button it is taking me to the Sql Warehouses page. Can anyone help resolve this?? This account already has all the required permissions and users with required…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-04-26T13:34:52.8833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 76%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Maxx
5
Reputation points
commented 2026-05-18T11:30:30.4566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 32%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECD%3C/text%3E%3C/svg%3E)
Christian Dahl Olin
0
Reputation points
3 answers
Deleted Databricks resource continues billing cost
Hi: I was using a serverless Databricks workspace for 5 days, and after I've deleted the resource, I'm continuing receiving charges for this resource. What Can I do to stop this increase =?
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-12T10:42:07.6466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 75%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EE%3C/text%3E%3C/svg%3E)
etellez
0
Reputation points
commented 2026-05-16T00:30:15.3866667+00:00
Bharath Y P
9,010
Reputation points Microsoft External Staff
Moderator
0 answers
Databricks: QUOTA_EXCEEDED: Cannot create 9 Privilege(s) in Metastore
I need to set up multiple Databricks environments for my team but it has not been possible because I am hitting this error: QUOTA_EXCEEDED: Cannot create 9 Privilege(s) in Metastore 593fe1dc-d560-4877-959d-cc5f686ee7bc (estimated count: 65006, limit:…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-05-14T19:59:30.42+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 56.00000000000001%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
Samir Char
0
Reputation points Microsoft Employee
commented 2026-05-14T20:28:35.46+00:00
SAI JAGADEESH KUDIPUDI
3,205
Reputation points Microsoft External Staff
Moderator
1 answer
Serverless job typed dataset transformations fail
I've been experiencing exceptions trying to run a custom Scala JaR in a serverless configuation. Eventually, I found that typed dataset operation cause the error. I've put together a minimal repro of the situation. I write some test data to a delta…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-03-20T16:06:00.1633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 42%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDR%3C/text%3E%3C/svg%3E)
David Regan
0
Reputation points
commented 2026-05-14T08:23:19.43+00:00
David Regan
0
Reputation points
2 answers
I have a Developer Support Plan, Unable to Submit Support Request
I have Developer Support but when walking through Create a Support Request, there is no option to actually submit.
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
asked 2026-04-22T01:52:26.1+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 72%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
jvg
0
Reputation points
commented 2026-05-13T00:56:36.04+00:00
SAI JAGADEESH KUDIPUDI
3,205
Reputation points Microsoft External Staff
Moderator
2 answers
One of the answers was accepted by the question author.
Is Service Endpoint Policy feature enabled for this Azure Databricks workspace?
SEP를 생성하려고 하는데, 아래와 같은 오류가 발생합니다. Found conflicts with NetworkIntentPolicy. Details: Subnet or Virtual Network cannot have resources or properties which conflict with network intent policy. Service endpoint policies on Subnet are not allowed as provided…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,955 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 82%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)