How to Retrieve Synapse Notebook Execution Metrics Using Log Analytics?

Question

I am trying to gather usage insights for Synapse Analytics notebook executions using Log Analytics. Specifically, I want to identify details such as the users with the highest notebook execution counts, execution durations, and other relevant metrics.

Does Synapse Analytics provide a built-in table or logs that can be queried with KQL to extract such information?

 

Answer 1

Hi @Gabriel-2005
Welcome to Microsoft Q&A platform and thanks for posting your query here.

Synapse Analytics doesn't directly log notebook execution metrics (like execution counts or durations) to Log Analytics by default. However, you can leverage Azure Monitor integration and custom logging to capture and analyze these details.

Here’s how you can retrieve and work with such metrics.

First, configure diagnostic settings and set up a Synapse workspace to send logs to the workspace.

Once the logs are sent, you can query them using the following sample query. Explore the AzureSynapseAnalyticsWorkspaces table to find notebook execution events:

<AzureSynapseAnalyticsWorkspaces> 
| where OperationName == "<required operation>" 
| summarize count() by Caller 
| top 20 by count_

Navigate to Logs > Synapse Workspace Logs and use a KQL query to query the AzureSynapseAnalyticsWorkspacesNotebookLogs.

This approach will allow you to retrieve the necessary logs effectively.

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.