shaded.databricks.org.apache.hadoop.fs.azure.AzureException: java.io.IOException: Blob operation is not supported

n k 106 Reputation points
2021-12-30T11:57:16.903+00:00

Hi Experts ,
Am trying to insert Data from Azure datalake gen2 to delta table (delta table in azure data lake gen2) via Copy Data Activity in Azure dataFactory.
At times i get this error 'ErrorCode=AzureDatabricksCommandError,Hit an error when running the command in Azure Databricks. Error details: shaded.databricks.org.apache.hadoop.fs.azure.AzureException: java.io.IOException: Blob operation is not supported'
The data which i am loading ~8k records and its small data
i checked the spark UI but don't see any failed jobs .

My source Dataset is created on Top of AzureDatalakeGen2 -->ParquetFormat
My Destination Dataset is created on Top of AzureDatabricks Deltalake --> Tablename
did anyone face anything like this anytime?
161368-image.png

161395-image.png

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,163 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,573 questions
{count} vote

1 answer

Sort by: Most helpful
  1. Pradeep Singh 1 Reputation point
    2022-02-10T11:13:53.527+00:00

    I am facing the same issue . my copy and move command worked fine yesterday and today it gives me this error . Please update here once you find a solution .

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.