Databricks notebook error output log to ADF

NIKHIL KUMAR 81 Reputation points
2022-10-03T19:12:28.413+00:00

I have ADB notebook however if notebook fails internally still the notebook activity doesn't fail when being called via ADF. How can I capture the error message of the notebook to the ADF pipeline .

In ADB notebook, I am using dbutils.notebook.exit() to capture error message and terminate the process.

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,904 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,472 questions
{count} votes

0 additional answers

Sort by: Most helpful