Azure Durable Function does not finish when I configured Azurite with multiple Storage Accounts.

Makoto Oda 291

I'm developing Azure Function (Python).

And I configuire Azurite with multiple Storage Accounts & Keys. I use Azurite from container, so I configure docker-compose.yml as follows:

# (omission)
services:
  azurite:
    image: mcr.microsoft.com/azure-storage/azurite
    ports:
      - 10000:10000
      - 10001:10001
      - 10002:10002
    environment:
      - AZURITE_ACCOUNTS=local-dev-sa-001:cGFzc3dvcmQ=;local-dev-sa-003:cGFzc3dvcmQ=;
    # (omission)

And I configure local.settings.json in Azure Function code as follows (other value is omitted):

{
  "Values": {
    "AzureWebJobsStorage": "DefaultEndpointsProtocol=http;AccountName=local-dev-sa-001;AccountKey=cGFzc3dvcmQ=;BlobEndpoint=http://127.0.0.1:10000/local-dev-sa-001;QueueEndpoint=http://127.0.0.1:10001/local-dev-sa-001;TableEndpoint=http://127.0.0.1:10002/local-dev-sa-001;"
  }
}

When I launch Azure Function App from Visual Studio Code with F5 and execute Durable Funcion, the funcion does not finish. Not only that, the function is executed multiple times. I confirmed from the log output on Visual Studio Code terminal pane.

The same code works fine when I use Azurite default configuration.

How do I fix this problem?

SaiKishor-MSFT 17,201 Reputation points

2023-03-16T19:14:15.8133333+00:00

@Makoto Oda Thanks for reaching out to Microsoft Q&A Forum.

When this issue occurs, do you see any error message? Can you please check your logs for any errors and let me know? Thanks!

Makoto Oda 291

@SaiKishor-MSFT
Thank you for your reply.

As for Azure Function, errors do not seem to happen. When I access statusQueryGetUri of the Durable Function response, runtimeStatus is Pending.

So I launched Azurite with debug log option.

Errors seem to happen as follows:

2023-03-17T04:59:23.245Z 972c1088-1962-4f2a-8daf-3fdb721e6109 error: ErrorMiddleware: Received an error, fill error information to HTTP response
2023-03-17T04:59:23.245Z 972c1088-1962-4f2a-8daf-3fdb721e6109 error: ErrorMiddleware: ErrorName=Error ErrorMessage=Couldn't extract path from URL in sub-Request:
 Content-Type: application/http
Content-Transfer-Encoding: binary

PUT http://127.0.0.1:10002/local-dev-sa-001/TestHubNameHistory(PartitionKey='56656b76b34949608390d67519214a09',RowKey='0000000000000000') HTTP/1.1
Accept: application/json;odata=minimalmetadata
Content-Type: application/json
DataServiceVersion: 3.0;

{"EventId":-1,"IsPlayed":false,"_Timestamp":"2023-03-17T04:59:23.1433773Z","_Timestamp@odata.type":"Edm.DateTime","EventType":"OrchestratorStarted","ExecutionId":"60e994a9e641437a881ab32a035c6faa"}
 ErrorStack="Error: Couldn't extract path from URL in sub-Request:\n Content-Type: application/http\r\nContent-Transfer-Encoding: binary\r\n\r\nPUT http://127.0.0.1:10002/local-dev-sa-001/TestHubNameHistory(PartitionKey='56656b76b34949608390d67519214a09',RowKey='0000000000000000') HTTP/1.1\r\nAccept: application/json;odata=minimalmetadata\r\nContent-Type: application/json\r\nDataServiceVersion: 3.0;\r\n\r\n{\"EventId\":-1,\"IsPlayed\":false,\"_Timestamp\":\"2023-03-17T04:59:23.1433773Z\",\"_Timestamp@odata.type\":\"Edm.DateTime\",\"EventType\":\"OrchestratorStarted\",\"ExecutionId\":\"60e994a9e641437a881ab32a035c6faa\"}\r\n\n    at /opt/azurite/dist/src/table/batch/TableBatchSerialization.js:65:23\n    at Array.map (<anonymous>)\n    at TableBatchSerialization.deserializeBatchRequest (/opt/azurite/dist/src/table/batch/TableBatchSerialization.js:52:45)\n    at TableBatchOrchestrator.processBatchRequestAndSerializeResponse (/opt/azurite/dist/src/table/batch/TableBatchOrchestrator.js:46:32)\n    at TableHandler.batch (/opt/azurite/dist/src/table/handlers/TableHandler.js:498:50)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:95:5)"
2023-03-17T04:59:23.245Z 972c1088-1962-4f2a-8daf-3fdb721e6109 error: ErrorMiddleware: Set HTTP code: 500

Would this information become a clue for your answer?

Makoto Oda 291

@SaiKishor-MSFT

Thank you for your reply.

As for Azure Function, errors do not seem to happen. When I access statusQueryGetUri of the Durable Function response, runtimeStatus is Pending.

So I launched Azurite with debug log option.

Errors seem to happen as follows:

2023-03-17T04:59:23.245Z 972c1088-1962-4f2a-8daf-3fdb721e6109 error: ErrorMiddleware: Received an error, fill error information to HTTP response
2023-03-17T04:59:23.245Z 972c1088-1962-4f2a-8daf-3fdb721e6109 error: ErrorMiddleware: ErrorName=Error ErrorMessage=Couldn't extract path from URL in sub-Request:
 Content-Type: application/http
Content-Transfer-Encoding: binary

PUT http://127.0.0.1:10002/local-dev-sa-001/TestHubNameHistory(PartitionKey='56656b76b34949608390d67519214a09',RowKey='0000000000000000') HTTP/1.1
Accept: application/json;odata=minimalmetadata
Content-Type: application/json
DataServiceVersion: 3.0;

{"EventId":-1,"IsPlayed":false,"_Timestamp":"2023-03-17T04:59:23.1433773Z","_Timestamp@odata.type":"Edm.DateTime","EventType":"OrchestratorStarted","ExecutionId":"60e994a9e641437a881ab32a035c6faa"}
 ErrorStack="Error: Couldn't extract path from URL in sub-Request:\n Content-Type: application/http\r\nContent-Transfer-Encoding: binary\r\n\r\nPUT http://127.0.0.1:10002/local-dev-sa-001/TestHubNameHistory(PartitionKey='56656b76b34949608390d67519214a09',RowKey='0000000000000000') HTTP/1.1\r\nAccept: application/json;odata=minimalmetadata\r\nContent-Type: application/json\r\nDataServiceVersion: 3.0;\r\n\r\n{\"EventId\":-1,\"IsPlayed\":false,\"_Timestamp\":\"2023-03-17T04:59:23.1433773Z\",\"_Timestamp@odata.type\":\"Edm.DateTime\",\"EventType\":\"OrchestratorStarted\",\"ExecutionId\":\"60e994a9e641437a881ab32a035c6faa\"}\r\n\n    at /opt/azurite/dist/src/table/batch/TableBatchSerialization.js:65:23\n    at Array.map (<anonymous>)\n    at TableBatchSerialization.deserializeBatchRequest (/opt/azurite/dist/src/table/batch/TableBatchSerialization.js:52:45)\n    at TableBatchOrchestrator.processBatchRequestAndSerializeResponse (/opt/azurite/dist/src/table/batch/TableBatchOrchestrator.js:46:32)\n    at TableHandler.batch (/opt/azurite/dist/src/table/handlers/TableHandler.js:498:50)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:95:5)"
2023-03-17T04:59:23.245Z 972c1088-1962-4f2a-8daf-3fdb721e6109 error: ErrorMiddleware: Set HTTP code: 500

Would this information become a clue for your answer?

Accepted answer

MuthuKumaranMurugaachari-MSFT 22,151 Reputation points

2023-03-22T13:55:56.3233333+00:00

Makoto Oda Thank you for sharing the additional info. Based on the error message, it appears to be issue with Table Storage endpoint [http://127.0.0.1:10002/local-dev-sa-001] with Azurite and I found similar issue that was fixed in #796 and open issue #1141 related to batch operations (workaround to use single operations).

However, there might be other cases and I request you to open a new issue in Azurite repo with details such as version, VS code extension, along with debug logs that you shared and let us know. That would help in engaging our product team to investigate further.
Please sign in to rate this answer.

1 person found this answer helpful.
Makoto Oda 291 Reputation points

2023-03-22T13:56:33.99+00:00

@MuthuKumaranMurugaachari-MSFT

Thank you for your reply. I posted the same question to Azure repo.

MuthuKumaranMurugaachari-MSFT 22,151 Reputation points

2023-03-22T13:58:32.29+00:00

Makoto Oda thanks for posting the question in GitHub.

Makoto Oda 291 Reputation points

2023-03-23T06:34:49.1233333+00:00

@MuthuKumaranMurugaachari-MSFT
Thank you for your help.

I could solve the problem by posting a GitHub issue.

I needed to set storage account names without "-".

MuthuKumaranMurugaachari-MSFT 22,151 Reputation points

2023-03-23T13:15:09.0366667+00:00

Makoto Oda Glad to hear that your issue is resolved. Appreciate you for sharing it.
Sign in to comment

Azure Durable Function does not finish when I configured Azurite with multiple Storage Accounts.

0 additional answers