Azure Databricks is not sending email when Databricks Alert condition is met
Azure Databricks is not sending an email to the destination email address when Databricks Alert condition is met, Sometimes this is working and sometimes not.
Azure Databricks Workspace: Users are being added to the admins group on their own
We have an Azure Databricks workspace with Unity Catalog enabled. We are using SCIM provisioning to sync some Entra security groups to the workspace so that we can control access to the catalog items. We have noticed that some users are being added…
Error when creating Access Connector for Azure Databricks
So, just created storage, and would like to setup the access connector, and faces the below error. Anyone seen this before ? All insights are very much appreciated
I dont see Account Console in Databricks. Please advise
I have personal account and when I log into databricks I dont see account console to admin stuff
Azure Databricks Compute Instance Quota Issue
Unable to create a compute instance in Azure Databricks due to a quota issue. The error message received is: This account may not have enough CPU cores to start a cluster. Contact your administrator to increase the limits. Additionally, it is noted…
Not able to create compute in Databricks on Azure Free Trialaccount
Hi Team, I am not able to create compute in Databricks on Azure Free Trial account. I tried all options for creating Databricks workspace - 14 days trial, standard account, premium account - but getting same error in all of these. Error message- This…
How to fix the below issue which I am facing while installing the maven library with coordinates as 'com.databricks:spark-xml_2.12:0.14.0'
How to fix the below issue which I am facing while installing the maven library with coordinates as 'com.databricks:spark-xml_2.12:0.14.0' in ADF pipeline in azure databricks notebook activity run failed with error message Library installation…
Automating conversion of python scripts to databricks notebook
I'm looking to convert a Python .py file into a format compatible with Databricks, where the file can be split into multiple cells without using the Databricks GUI. Eventually, I’d like to automate this process. What’s the minimal code needed to create a…
Notebook : AccessDeniedException
Hello, I am trying to save a delta/parquet file into the ADLS Gen2 using a PySpark Notebook as follows : delta_output_path =…
is there a spark connector for Azure Cosmos DB MongoDB API RU?
I'm using Azure Databricks to develop a proof of concept. Is there support for a Spark Connector for Azure Cosmos DB MongoDB API? If yes, what versions are supported. Is both batch and stream operations supported?
copy tables from sql server on-prem to .parquet format in delta lake
Currently our copy process for 10 tables is running in pipeline in ADF, our source is ON-PREM SQL Server and target is in BLOB Storage GEN2. it copies data(tables) in parquet file format in HOT storage Account --- StorageV2 (general purpose v2) but I…
I don't have access to admin console of databricks even though I am admin user
I created azure account and launched databricks, I don't have access to admin console of databricks even though I am the only admin user
Unable to access account console in daatabrics
Hello guys I created a storage account through my pay as u go subscription and lauched a premium tier workspace for databricks but i was trying to connect my workspace to metastore in unity catalog but i dont see my manage account button to access…
I am not able to execute the "df.write.mode("overwrite").format('csv').option("path", "/mnt/sepadls/bronze/Employee").saveAsTable("Employee_Ext")
I am trying to create a folder called Employee in bronze layer and register as a table in hive meta store and below is the code. It's creating a folder called Employee in bronze layer but table is not getting registered and throwing an error as …
Complete Azure Databricks Cluster Recommendation
Hi, We are working on a project where we need to create Databricks cluster configurations recommendation with cluster versions, modes etc etc. Can anyone help ?
Connection Challenges with Azure Databricks and SQL Server On VM in Serverless compute.
We successfully configured VNet peering between the SQL VM's VNet and the Databricks VNet, allowing access to the SQL Server on VMs. Testing the connection from Databricks using a job cluster yielded successful results, confirming that everything…
not able to create a unity catalog
i want to create a unity catalog in azure databricks. manage account console is not accessible on azure databricks once i launch a workspace despite the "globle administrative role access" and premium subscription of azure…
Unable to Access Azure Databricks Admin Console as Global Administrator
I'm a Global Administrator in my Azure AD tenant, but I'm unable to access the Azure Databricks admin console for my workspace. Despite having full permissions across Azure AD, I’m encountering issues when trying to log in to manage Databricks. Has…
worker and driver node
Hi, To process 100000 records how to calculate number of worker and driver nodes
Unable to Create Compute Clusters After Upgrading to Pay-As-You-Go
After upgrading from a free trial to a pay-as-you-go account, the ability to create compute clusters has been lost. The error message received is: "This account may not have enough CPU cores to start a cluster. Contact your administrator to increase…