Integrating Application insight with Azure Databricks and Azure DataFactory

Sharukh Kundagol 145 Reputation points
2023-02-23T19:30:54.8666667+00:00

Can we Integrate Application insight with Azure Data bricks and Azure Data Factory?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
{count} votes

Answer accepted by question author
  1. Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator
    2023-02-25T00:42:27.58+00:00

    Hello @Sharukh Kundagol,

    Welcome to the MS Q&A platform.

    Here is a blog post explained about how to configure data bricks to send events to App insights.

    For ADF, you can use Web Activity to invoke the Application Insights REST API after the execution of your main activities(Or use Execute Pipeline Activity to execute your root pipeline and get the status or output of it). Then send it to App Insights REST API.

    Please refer to this document:https://www.ben-morris.com/using-azure-data-factory-with-the-application-insights-rest-api/

    This thread is discussed here.

    I hope this helps. Please let me know if you have any further questions.

    If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Joe B 0 Reputation points
    2024-01-30T19:24:05.74+00:00

    Considering that this is a first party service from Microsoft, I am surprised that there is no out-of-the-box solution for telemetry and monitoring with AppInsights.

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.