Azure storage queue: processed message comes back to the queue after 10 minutes

Question

Azure storage queue: processed message comes back to the queue after 10 minutes

Yan Wang 1

I have an Azure function triggered by the storage queue, and once the message processed successfully by the function, after 10 minutes, the same message comes back to the queue again. The message seems retry even though it was processed successfully. The MessageVisibilityTimeout is the default value. Any suggestions on fixing this issue?

SaiKishor-MSFT 17,341 Reputation points Moderator

2022-09-15T19:59:22.783+00:00

@Yan Wang Thanks for reaching out to Microsoft Q&A.

Are you deleting the messages once the message is successfully received? Please check this doc on how to do this- https://learn.microsoft.com/en-us/azure/storage/queues/storage-tutorial-queues?toc=%2Fazure%2Fstorage%2Fqueues%2Ftoc.json&tabs=dotnet%2Cenvironment-variable-windows#dequeue-messages

Please also refer to this similar issue here- https://stackoverflow.com/questions/54108683/queue-trigger-azure-function-queue-messages-processed-more-than-once
Yan Wang 1 Reputation point

2022-09-15T23:53:34.097+00:00

Hi SaiKishor,

Thank you for the information. I was thinking manually delete the message in the end of the Azure function but I thought the Queue trigger function should manage the message dequeue after successfully processed. My function app only runs 500ms for one transaction and did not see exception of timeout yet. I am using premium plan.

For the second link, I will check the log information again to see any exception.

Any other related docs or solution please send me as well.

1 answer

Your answer

SaiKishor-MSFT 17,341 Reputation points Moderator

2022-09-15T19:59:22.783+00:00

@Yan Wang Thanks for reaching out to Microsoft Q&A.

Are you deleting the messages once the message is successfully received? Please check this doc on how to do this- https://learn.microsoft.com/en-us/azure/storage/queues/storage-tutorial-queues?toc=%2Fazure%2Fstorage%2Fqueues%2Ftoc.json&tabs=dotnet%2Cenvironment-variable-windows#dequeue-messages

Please also refer to this similar issue here- https://stackoverflow.com/questions/54108683/queue-trigger-azure-function-queue-messages-processed-more-than-once
Yan Wang 1 Reputation point

2022-09-15T23:53:34.097+00:00

Hi SaiKishor,

Thank you for the information. I was thinking manually delete the message in the end of the Azure function but I thought the Queue trigger function should manage the message dequeue after successfully processed. My function app only runs 500ms for one transaction and did not see exception of timeout yet. I am using premium plan.

For the second link, I will check the log information again to see any exception.

Any other related docs or solution please send me as well.

Answer 1

SaiKishor-MSFT 17,341 Moderator

@Yan Wang I just checked with the Functions team and they suggested checking for the Function logs to check if the function is getting stuck and if it is actually completing. Here is how to lok for logs- https://learn.microsoft.com/en-us/azure/azure-functions/monitor-functions?tabs=portal#analyzing-logs

Please let me know what you observe and share any logs if possible. Thank you!

SaiKishor-MSFT 17,341 Reputation points Moderator

2022-09-19T23:19:41.727+00:00

@Yan Wang Any update?
Yan Wang 1 Reputation point

2022-09-20T22:31:31.993+00:00

Hi SaiKishor,

Sorry for the late reply and I have checked the log but only can see exception System.Threading.Tasks.TaskCanceledException:
at Azure.Core.CancellationHelper.ThrowOperationCanceledException (Azure.Core, Version=1.25.0.0, Culture=neutral, PublicKeyToken=92742159e12e44c8)
at Azure.Core.Pipeline.ResponseBodyPolicy.ThrowIfCancellationRequestedOrTimeout

Which I am not sure how it comes. I will update my code to see whether the issue still happens.
SaiKishor-MSFT 17,341 Reputation points Moderator

2022-09-22T01:58:24.867+00:00

@Yan Wang Thank you, please do let me know if you need any further assistance. Thank you!

Please let us know if you have any more questions and we will be glad to assist you further. Thank you!

Remember:

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

Want a reminder to come back and check responses? Here is how to subscribe to a notification.
Yan Wang 1 Reputation point

2022-09-26T07:07:03.123+00:00

Hi SaiKishor,

I did a test today and check the Azure function logs as you suggested and could not find any exceptions and the message comes back to the queue and processed again after 10 mins.

I do not have much in the logs and could not figure out why the payload comes back to the queue again.

Any other suggestions?

Thanks,
Rebekah