How to fix Authenticate Error when I try to use web activity in Azure data factory to post a message to Azure Queue storage

Question

How to fix Authenticate Error when I try to use web activity in Azure data factory to post a message to Azure Queue storage

Steven Wu 0 Microsoft Employee

I am trying to create a message from ADF web activity to Azure queue storage,

Here is the screenshot of my activity in ADF:

User's image

And I also grant the storage queue data contributor role to the ADF I used, but when I try to run this web activity, I get this error when I try to run this activity:

<?xml version="1.0" encoding="utf-8"?><Error><Code>AuthenticationFailed</Code><Message>Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature. RequestId:c02aa40d-4003-0032-4518-94ac4a000000 Time:2023-05-31T23:34:03.4900645Z</Message><AuthenticationErrorDetail>Authentication scheme Bearer is not supported in this version.</AuthenticationErrorDetail></Error>

Thanks

ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator

2023-06-20T08:38:48.2733333+00:00

Hi Steven Wu, Just checking if below answer helpful. If yes, please consider hitting Accept Answer button. Accepted answers help community as well. Thank you.
PRADEEPCHEEKATLA 91,496 Reputation points Moderator

2023-06-27T05:21:24.4033333+00:00

@Steven Wu - We received your feedback that the answer provided on the thread was not helpful.

Kindly let us know what we could have done better to improve the answer and make your engagement experience good. We are here to help you and strive to make your experience better and greatly value your feedback.

Our enginner have provided a detailed answer which has clear steps for which you are looking for. If you wish, you may re-surveying/rating for the engagement you received on the thread. Your feedback is very important to us.

Looking forward to you reply. Much appreciate your feedback!

Regards,

PRADEEPCHEEKATLA-MSFT

2 answers

Your answer

ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator

2023-06-20T08:38:48.2733333+00:00

Hi Steven Wu, Just checking if below answer helpful. If yes, please consider hitting Accept Answer button. Accepted answers help community as well. Thank you.
PRADEEPCHEEKATLA 91,496 Reputation points Moderator

2023-06-27T05:21:24.4033333+00:00

@Steven Wu - We received your feedback that the answer provided on the thread was not helpful.

Kindly let us know what we could have done better to improve the answer and make your engagement experience good. We are here to help you and strive to make your experience better and greatly value your feedback.

Our enginner have provided a detailed answer which has clear steps for which you are looking for. If you wish, you may re-surveying/rating for the engagement you received on the thread. Your feedback is very important to us.

Looking forward to you reply. Much appreciate your feedback!

Regards,

PRADEEPCHEEKATLA-MSFT

Answer 1

AnnuKumari-MSFT 34,566 Microsoft Employee Moderator

Hi Steven Wu ,

Welcome to Microsoft Q&A platform and thanks for posting your question here.

As I understand your query, you are trying to make a post request to the Azure Queue storage via Web activity in ADF , however , it is throwing authentication Error. Please let me know if that is not the correct understanding.

Probably , here you are missing on Authorization header. An authorized request requires two headers: the Date or x-ms-date header and the Authorization header.

You need to generate SAS key and pass the same in authentication header value in the below format:

Authorization: SharedKey myaccount:ctzMq410TV3wS7upTBcunJTDLEJwMAZuFPfr0mrrA08=

and x-ms-date with this syntax: Fri, 26 Jun 2015 23:39:12

For more details, kindly refer the below resources:

Authorize with Shared Key

Azure blob GET request authorization header "x-ms-date" field issue

Hope it helps. Kindly accept the answer by clicking on Accept answer button. Thankyou

Steven Wu 0 Reputation points Microsoft Employee

2023-06-01T18:20:31.3166667+00:00

Hi Annu,

Thanks for the information. However, can I know is there anyway we can not expose the SAS key for compliance concern? I also found this related question: https://learn.microsoft.com/en-us/answers/questions/770303/get-message-from-azure-queue-using-web-activity-in and id didn't include the Authorization header and the managed identity of the ADF itself is enough. But in the article it work but when I try in ADF with the same behavior it failed. So can I know if there is any change in the Queue storage rest api side? Or do I miss something?
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator

2023-06-15T13:44:59.0466667+00:00

Hi Steven Wu,

You can consider storing your Key in Azure key Vault and get the key from there too.

Kindly try above approach and let me know how it goes.

If above helps, then please consider hitting Accept Answer button. Accepted answers help community as well.
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator

2023-06-19T09:16:07.57+00:00

Hi Steven Wu, Just checking if above answer helpful. If yes, please consider hitting Accept Answer button. Accepted answers help community as well. Thank you.

Answer 2

Hi Steven Wu,

I was stuck with a similar issue, I was able to solve it with SAS Authentication and following set up:

URL composition: @concat('https://', account, '.queue.core.windows.net/', ContainerQueue, '/messages?visibilitytimeout=30&timeout=30','&', SASKey)

URL resulting:

https://sadatadata.queue.core.windows.net/queue-to-proccess/messages?visibilitytimeout=30&timeout=30&sv=2022-11-02&ss=bfqt&srt=sco&sp=rwlayx&se=2023-10-31T23:18:25Z&st=2023-10-03T15:18:25Z&spr=https&sig=F9ITtRQHY%3D

InkedWebActivity_LI

I hope it help you.

Share via

How to fix Authenticate Error when I try to use web activity in Azure data factory to post a message to Azure Queue storage

2 answers

Your answer