Hi, I have setup a webjob of type triggered in azure app service which is running nodejs code at every minute( So there is no webjob SDK used). There are few console.log() lines in the code which are getting logged to output_log.txt. But I want to stream these logs to log analytics workspace(application insights). When the app insights is enabled for that app service in which webjob is running the webjob console logs are not included in app insights. How can I add these console logs of webjob to log analytics workpace.?

Hi @Naveen Kumar Jain S , You can create an Application Insights resource that's workspace-based . The logging you're doing to you output_log.txt you can send to AppInsights using code-based monitoring . This option is real-time; however, you also have the option of ingesting output_log.txt using a logic app . You can store the log file in a storage account and the logic app will grab this file and upload it into the log analytics workspace. There's also HTTP Collector API method currently in preview that you can write code in your webjob to push that data itself.

Azure webjob output logs streaming to log analytics workspace

Accepted answer

Ryan Hill 28,091 Reputation points Microsoft Employee

2021-11-24T14:04:52.67+00:00

Hi @Naveen Kumar Jain S ,

You can create an Application Insights resource that's workspace-based. The logging you're doing to you output_log.txt you can send to AppInsights using code-based monitoring. This option is real-time; however, you also have the option of ingesting output_log.txt using a logic app. You can store the log file in a storage account and the logic app will grab this file and upload it into the log analytics workspace. There's also HTTP Collector API method currently in preview that you can write code in your webjob to push that data itself.
Please sign in to rate this answer.
Naveen Kumar Jain S 41 Reputation points

2021-11-24T17:13:04.757+00:00

Thanks @Ryan Hill for responding to my query.

I did code based monitoring as you suggested by including app insight SDK for node.js which will store the logs in AppTrace table of azure application insights which is workspace based.

I'm using bunyan library for logging in my application, but the problem is if any error logged using bunyan library in the catch block, that log is not appearing in application insights AppTrace table where are console logged stackTrace is getting to App Insights but not the JSON log which is logged using bunyan library.

The current configuration of app insights sdk is used as below.

let appInsights = require('applicationinsights') //importing bunyan appInsights.setup("instumentation-key") .setAutoCollectConsole(true,true) .setAutoCollectExceptions(true) .setSendLiveMetrics(true) .start() async function hellofun() { try { logger.info('<message>')// pushed to app insights }catch(ex){ logger.error('<message>')// not pushed to app insights console.log(err)// pushed to app insights }

What might be the issue?

Ryan Hill 28,091 Reputation points Microsoft Employee

2021-11-24T21:07:58.48+00:00

I found this note under SDK Configuration.

By default setAutoCollectConsole is configured to exclude calls to console.log (and other console methods). Only calls to supported third-party loggers (for example, winston and bunyan) will be collected. You can change this behavior to include calls to console methods by using setAutoCollectConsole(true, true).

If you're seeing issues, it could be an issue with the bunyan library or how App Insights SDK interacts with bunyan. I would file a new issue.

Naveen Kumar Jain S 41 Reputation points

2021-11-25T16:06:18.827+00:00

Yes. I have included the configuration setAutoCollectConsole(true, true) for appInsights sdk in my code.

But my issue is if I have a bunyan log line in catch block ( try catch code flow of nodejs ), that log is not getting pushed/traced by app insights as i'm unable to see that log line in catch block when I run query for AppTrace table of Application insights.

I'm not able to understand why only the log line catch block is not getting logged in AppTrace table by appInsights SDK for nodejs.?

Ryan Hill 28,091 Reputation points Microsoft Employee

2021-12-07T02:33:28.787+00:00

There were some changes made to Application Insights in how errors are handled for Bunyan. It may or may not be the cause of the issue. I still advise filing a new issue in App Insights repo.

Naveen Kumar Jain S 41 Reputation points

2022-02-08T12:16:13.23+00:00

I tried object destructuring the caught error before logging and it worked.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure webjob output logs streaming to log analytics workspace

0 additional answers

Your answer