Need Help in end to end tracking of logs from azure durable function (NodeJS)

Question

Need Help in end to end tracking of logs from azure durable function (NodeJS)

MuhamedSalihSI 71

Hi Team,
we are using application insight v1.8.9 and NodeJS v14.
Need assistance in end to end / monitoring of log from azure durable function written in NodeJS.

Thanks in advance.

Regards,
Muhamed

1 answer

Your answer

Answer 1

MikeUrnun 9,777 Moderator

Hello @MuhamedSalihSI

By E2E tracking of logs, if you mean being able to correlate telemetries in your Application Insights per orchestration basis, I believe the following blog post might be of help: Durable Functions’ Distributed Tracing

MikeUrnun 9,777 Reputation points Moderator

2021-04-13T16:32:21.933+00:00

@MuhamedSalihSI Just following up on the answer above, I hope the Distributed Tracing is helpful to what you're looking to achieve.
MuhamedSalihSI 71 Reputation points

2021-04-14T07:27:23.843+00:00

Hi @MikeUrnun - Sorry for the late reply.

Note: we are using NodeJS Azure durable function (Orchestration and activities with blob/ service bus triggers).

But this article says the E2Etracking feature view/tracking is available only for C#
"As the first alpha version, we support C# only. However, we are going to support other languages as well." ~"Tsuyoshi Ushio @ limitation section"

Can we have some sort of query/view/anything in appinsights or log analytics to achieve e2etracking of durable function developed in nodejs?
MikeUrnun 9,777 Reputation points Moderator

2021-04-20T02:59:07.53+00:00

@MuhamedSalihSI I'm sorry that I overlooked those details. Since the built-in support is yet to be made available for Nodejs runtime, please consider using the App Insights SDK for NodeJS per your requirements: Monitor your Node.js services and apps with Application Insights
MuhamedSalihSI 71 Reputation points

2021-04-20T21:41:24.817+00:00

@MikeUrnun ,
Please Not be sorry, The Info from "Tsuyoshi Ushio" is quiet useful when trying to understand some part of durable function's logs.

Ok we are already using application Insight Nodejs SDK v1.8.9. again I am ambitiously searching for way to correlate log among trigger ,orchestrator and activity functions, But I can group log in trigger separately then orchestrator separately so on.
Need a way to correlate end to end.
MikeUrnun 9,777 Reputation points Moderator

2021-04-21T01:40:12.787+00:00

Thank you, @MuhamedSalihSI ! Glad to hear that the blog post was useful. As for correlating telemetries, is it because you have multiple orchestrators? If only one, you can probably use Instance ID of executing orchestration and pass it among activity functions, right?
MuhamedSalihSI 71 Reputation points

2021-04-23T10:49:52.567+00:00

Yes, we have only one orchestration, But I tried with wrapping correlation wrapper function in nodejs as this link says https://github.com/microsoft/ApplicationInsights-node.js#azure-functions-example.
Still I cant correlate end to end logs of trigger orchestration and activity under same operation id.

I assume you are speaking about the instance Id paramaeter of orchestrator start method (const instanceId = await client.startNew(req.params.functionName, undefined (INSTANCE ID), req.body);
),
INSTANCE ID:
https://learn.microsoft.com/en-us/azure/azure-functions/durable/durable-functions-orchestrations?tabs=javascript#orchestration-identity

But I am not sure how to correlate logs with the instance ID of azure durable functions?
Can you elaborate the steps or if my assumption is wrong can you suggest steps of your method to corelate e2e logs in single durable orchestration
MuhamedSalihSI 71 Reputation points

2021-04-23T10:54:32.77+00:00
Points to Consider:

Nodejs implementation

We have no external orchestrator ,no entity functions, Only one trigger function , one orchestrator and multiple activities .

we use nodejs application insight v1.8.9 sdk to track the logs
MikeUrnun 9,777 Reputation points Moderator

2021-04-28T06:00:41.217+00:00

Sure, I'll try to repro and let you know what I find.
Sarthak Chokshi 1 Reputation point

2021-05-26T23:48:31.597+00:00

Were you able to reproduce or make it work?

Share via

Need Help in end to end tracking of logs from azure durable function (NodeJS)

1 answer

Your answer