Notebook execution is in Failed state in SynapseNotebook

Abinash Tumulu 56 Reputation points Microsoft Employee
2022-02-15T08:56:25.253+00:00

When Synapse pipeline fails because of Notebook, this error can be seen in Monitor tab of Synapse Studio.
However, in log analytics it doesn't show the error. Is there a way to get error details form Log analytics?

LogAnalytics error:
SynapseIntegrationPipelineRuns
| where Level =='Error'

Issue:
we keep getting Notebook failure error "Notebook execution is in Failed state".
Created ticket with support team but they said this is transient.

We have an alert/ICM getting triggered when there is a pipeline failure. However, when pipeline fails with above mentioned error don't want to create alert/ICM. But log analytics doesn't have the error message, it just mentions pipeline failed.

Any tips how to address this situation?

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
2,829 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
.NET Machine learning
.NET Machine learning
.NET: Microsoft Technologies based on the .NET software framework.Machine learning: A type of artificial intelligence focused on enabling computers to use observed data to evolve new behaviors that have not been explicitly programmed.
150 questions