Azure Databricks

How to run Lakeflow connector pipeline in Databricks ?

I am using Azure Databricks Lakeflow Connect (Public Preview) to ingest CDC data from Azure SQL. My subscription is Pay-As-You-Go (0d339ce2-e789-41a0-8ca5-35d7dde18867). Lakeflow Connect creates a Gateway that requires serverless compute clusters to be…

Establishing a Connection between ADLS Gen2, Databricks and ADF In Microsoft Azure

Hello, May, Someone please help me with establishing connection between ADLS Gen2, Databricks and ADF, full steps if possibble. Do I need to route through key-vault, this is i am first time doing in production,. May somebody please share detailed step…

Py4JError: ('Method public com.databricks.backend.daemon.dbutils.DBUtilsCore$Result com.databricks.backend.daemon.dbutils.DBUtilsCore.mount() is not whitelisted on class class com.databricks.backend.daemon.dbutils.DBUtilsCore',)

While mounting storage location i am getting below error Py4JError: ('Method public com.databricks.backend.daemon.dbutils.DBUtilsCore$Result com.databricks.backend.daemon.dbutils.DBUtilsCore.mount() is not whitelisted on class class…

Databricks multinode clusters on one subscription cannot perform any Spark operations (executors lost, quota errors, infinite waits)

We are experiencing a critical issue on a single Azure subscription where Databricks multinode clusters are unable to run any Spark operations such as display() or count() on external tables. The same workloads, configurations, and external locations…

Not able to have manage account in databricks console

my databricks manage account not showing up

unity catalog

Hi Team how to configure databricks untity catalog using azure free trial or any other option

Facing below error message when trying to create a storage credential in Databricks

Getting above message when trying to create a storage credential under Databricks, i am not sure how to proceed, please assist.

ADB WS error

Not able to create a Workspace . error :-The workspace 'adb2' is in a failed state and cannot be launched. Please review error details in the activity log tab and retry your operation. Status Failed Resource group db-training-001 Location West…

Currently databricks workspace is in deploying state and not able to delete or create

Error creating service credentials from Access Connector in Azure Databricks

I set up an Access Connector for Azure Databricks and granted it Blob Contributor access on the target storage account. Since service credentials are required, I tried creating them using this Access Connector (managed identity). However, I keep getting…

Getting below error when trying to create a Data Quality Monitor for the table.""Cannot create Monitor because it exceeds the number of limit 500."

Getting below error when trying to create a Data Quality Monitor for the table." "Cannot create Monitor because it exceeds the number of limit 500."

Does Azure hosted Databricks Unity catalog support wallet based Oracle Connection?

I have a Databricks Unity catalog in my Azure Databricks Service workspace, and I'm trying to create a connection to an Oracle Autonomous Database (ADB). In the Workspace UI, the "Create Connection → Oracle" option only accepts hostname / port…

HOW TO GET ADMIN RIGHTS TO SETUP METASTORE

i have developer subscription. How to setup admin rights to create metastore.i tried login to databricks accounts as well but its showing error

Databricks Cluster Deployment Error: BOOTSTRAP_TIMEOUT (SERVICE_FAULT)

Assistance is needed with an issue encountered while deploying a cluster in Databricks UAT. The following error message is received: run failed with error message cluster 305161200-quoa9grg was terminated. Reason: BOOTSTRAP_TIMEOUT (SERVICE_FAULT)

Error in Azure Databricks spark.conf.set

Hi everyone, I am trying to configure a connection from Azure Databricks to Azure Data Lake Storage (ADLS). I have already provided the correct storage account name and access key, but I keep receiving the following error: spark.conf.set( …

Data Pipeline for Bringing Data from Oracle Fusion to Azure Databricks

Hello, I am trying to bring Oracle Fusion (SCM, HCM, Finance) Data and push to ADLS Gen2. Databricks used for Data Transformation and Powerbi used for Reports Visualization. I have 3 Option. Option 1 : Option 2 : Option 3 : May someone please help me…

Regarding data ingestion into the databricks

I pushed my dataset into Azure Event Hub, and I am trying to ingest that data into the Bronze layer that I created in Azure Database Zen2 using Databricks. However, I am unable to complete the ingestion. I keep encountering different errors during the…

How to enable metastore in azure databricks.

I have made a new account with pay as you go subscription. Also added an external user with email having organisation domain not a personal email. Felt like azure entra was not letting me get in. Now after creating VPCs and launch databricks is fine. But…

How do I release a name of the deleted workspace, I need to recreate it in a different subscription

I've created Databricks workspaces using bicep but forgot to change subscription when creating a production one. So I immediately deleted workspace that I accidentally created in the dev subscription and recreated in the prod one. Unfortunately the…

Use of vnet service endpoint with Azure Databricks delegated subnet

Hello, I am trying to use a Microsoft.Storage vnet service endpoint on a subnet delegated to Azure Databricks (Microsoft.Databricks/workspaces) as part of a workspace deployed with VNet injection. The service endpoint is enabled on the delegated subnet,…