I am facing the same issue . my copy and move command worked fine yesterday and today it gives me this error . Please update here once you find a solution .
shaded.databricks.org.apache.hadoop.fs.azure.AzureException: java.io.IOException: Blob operation is not supported
Hi Experts ,
Am trying to insert Data from Azure datalake gen2 to delta table (delta table in azure data lake gen2) via Copy Data Activity in Azure dataFactory.
At times i get this error 'ErrorCode=AzureDatabricksCommandError,Hit an error when running the command in Azure Databricks. Error details: shaded.databricks.org.apache.hadoop.fs.azure.AzureException: java.io.IOException: Blob operation is not supported'
The data which i am loading ~8k records and its small data
i checked the spark UI but don't see any failed jobs .
My source Dataset is created on Top of AzureDatalakeGen2 -->ParquetFormat
My Destination Dataset is created on Top of AzureDatabricks Deltalake --> Tablename
did anyone face anything like this anytime?