azure databricks

Question

i want to access my file which is in azure container name as test1. when I am uploading it I am having error

shaded.databricks.org.apache.hadoop.fs.azure.AzureException: hadoop_azure_shaded.com.microsoft.azure.storage.StorageException: Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.

here is my code

df = spark.read.format(file_type).option("inferSchema", "true").load(file_location)

df = spark.read.csv("/mnt/test1/employe.csv")

df.show()

Answer 1

Hi @Muqaddas Abbas ,

Thanks for posting query in Microsoft Q&A Platform.

Is your storage account is firewall enabled? If yes, kindly check below link where it discussed about working with storage accounts which has firewall enabled.
https://stackoverflow.com/questions/54018584/azure-databricks-accessing-blob-storage-behind-firewall

Also, similar issue discussed at below post. Kindly check if that helps too.
https://learn.microsoft.com/en-us/answers/questions/334786/index.html

Please let us know how it goes. Thank you.