Share via

Databricks notebook error output log to ADF

NIKHIL KUMAR 126 Reputation points
2022-10-03T19:12:28.413+00:00

I have ADB notebook however if notebook fails internally still the notebook activity doesn't fail when being called via ADF. How can I capture the error message of the notebook to the ADF pipeline .

In ADB notebook, I am using dbutils.notebook.exit() to capture error message and terminate the process.

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,514 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
Accepted answer
  1. Pratik Somaiya 4,211 Reputation points Volunteer Moderator
    2022-10-04T05:34:19.42+00:00

    Hello @NIKHIL KUMAR

    Can you add the Exception in the notebook and by raising it as below the notebook activity will fail if the notebook in Databricks fails 

    raise Exception("Error")
    1 person found this answer helpful.
    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.