Make sure the value of Authorization header is formed correctly including the signature

Faisal Qureshi 35

I am practicing with Azure Databricks and during setting the spark configuration for sasEntity, sasToken, I get the below error.

shaded.databricks.org.apache.hadoop.fs.azure.AzureException: hadoop_azure_shaded.com.microsoft.azure.storage.StorageException: Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.

I have checked the output of below command for returned values.

datasource = spark.conf.get("com.databricks.training.azure.datasource").split("\t")

It does return the required 3 values, source, sasEntity, sasToken and is not empty.

Could someone please explain me why spark configuration is complaining for setting the token value returned by the get command above.

I'm referencing the week3 material in course "Microsoft Azure Databricks for Data Engineering", titled "04-Working-With-Dataframes"

Thanks,

Faisal

KranthiPakala-MSFT 46,592 Reputation points Microsoft Employee

2023-04-03T21:45:03.7133333+00:00

@Faisal Qureshi Just checking in to see if the below information was helpful. If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. If you have any further query, do let us know. Thank you
Faisal Qureshi 35 Reputation points

2023-04-03T22:52:39.39+00:00

Thank you for the response. When you say check the syntax and formatting of the spark configuration, what do I check it against? Is there a SAS token format standard that i can refer to? Also, how can i verify that the SAS token is still valid?
Faisal Qureshi 35 Reputation points

2023-04-03T22:55:13.83+00:00

@KranthiPakala-MSFT , i have posted my questions to the response i received for my post. i still don't quite understand how to check for the proposed resolution
Sedat SALMAN 14,140 Reputation points MVP

2023-04-03T23:14:20.0966667+00:00

Based on the provided information, it appears that the SAS token value is being retrieved correctly using the spark.conf.get command. However, it's possible that there is an issue with how the token value is being used in the spark configuration.

It's recommended to double-check the syntax and formatting of the spark configuration, specifically the parts that involve the SAS token. You may also want to verify that the SAS token is still valid and has the necessary permissions to access the Azure storage resources.
KranthiPakala-MSFT 46,592 Reputation points Microsoft Employee

2023-04-03T23:15:13.5466667+00:00

@Faisal Qureshi - Thanks for your response. Could you please share the link which you are following so that I can double check and let you know my findings.

Thanks

Faisal Qureshi 35

Here's the link -

https://github.com/solliancenet/microsoft-learning-paths-databricks-notebooks/blob/master/data-engineering/DBC/04-Working-With-Dataframes.dbc?raw=true

Faisal Qureshi 35 Reputation points

2023-04-05T12:34:07.8933333+00:00

Hi @KranthiPakala-MSFT , did you get a change to look into it?
Faisal Qureshi 35 Reputation points

2023-04-16T19:23:40.5833333+00:00

Is anybody looking into it? , @Sedat SALMAN ? i see the SignedExpiry (se) parameter set to se=2023-04-01. Does this mean you would you need to change the expiry date for the source access policy? I have tried changing the se parameter in the notebook 'Dataset-Mounts' in the module getAzureMapping to a future date but it doesnt seem to work. Please let me know the associated changes i need to make on my end. All the tokens seems to have expired. is it possible for you to provide new tokens ? source - wasbs://training@dbtraincanadacentral.blob.core.windows.net/ sasEntity - fs.azure.sas.training.dbtraincanadacentral.blob.core.windows.net sasToken - ?ss=b&sp=rl&sv=2018-03-28&st=2018-04-01T00%3A00%3A00Z&sig=dwAT0CusWjvkzcKIukVnmFPTmi4JKlHuGh9GEx3OmXI%3D&srt=sco&se=2023-04-01T00%3A00%3A00Z
KranthiPakala-MSFT 46,592 Reputation points Microsoft Employee

2023-05-05T17:24:03.6466667+00:00

@Faisal Qureshi Sorry for the delay. I'm not able to access the link you have provided. But as you mentioned seems like the SAS token has been expired which is causing the above error. As this related to certifications, if you are still blocked, I would recommend reaching out in their dedicated forum who would be able to assist and update the trainings accordingly.

Microsoft Certification / Exams is currently not supported in the Q&A forums.

**
Microsoft Training & Certification is supported on their own forums:**
Microsoft Training & Support: https://trainingsupport.microsoft.com/
Microsoft Transcript - Missing Exams or Certificates: https://trainingsupport.microsoft.com/en-us/mcp/forum/mcp_prof-mcp_trans-mcp_missingexams

1 answer

KD Name 0 Reputation points

2023-11-23T18:03:55.88+00:00

Any one able to solve this issue? I am also facing the same issue with all notebooks from

https://github.com/solliancenet/microsoft-learning-paths-databricks-notebooks/tree/master/data-engineering/DBC

Error:

shaded.databricks.org.apache.hadoop.fs.azure.AzureException: hadoop_azure_shaded.com.microsoft.azure.storage.StorageException: Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Make sure the value of Authorization header is formed correctly including the signature

1 answer

Your answer