Store procedure use efficiently

azure_learner 615 Reputation points
2024-10-21T08:07:05.3966667+00:00

Hi experts, I have the store procedure below. Do I need to put it at the end of every activity? It won't be easy having this way.

Can I use it once to get information about all pipeline logging?

https://learn.microsoft.com/en-us/answers/questions/1922633/how-to-capture-the-each-activity-logs-in-the-table

Please help with a list of steps to follow. Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
0 comments No comments
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator
    2024-10-21T09:01:30.8733333+00:00

    Hi azure_learner ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your query here.

    I understand that you are trying to store all the activity logs after it's completion and using stored procedure for doing the same. But you want to know if there is any feasible way of achieving this without adding it after each and every activity.

    If your requirement is to capture the error logs, you can add the stored procedure at the end of the pipeline with the 'On Skip' conditional path.

    However, if you want to log even the success then Instead of using Stored procedure after every activity which looks tedious process, you can consider using Azure monitor Log diagnostic for doing the same as mentioned in the above thread which you shared :

    All the info will be logged in your storage account in form of Json format under today's date file in the format: yyyy-->Mm-->dd-->hh-->mm-->ss

    enter image description here

    enter image description here

    Hope it helps. Kindly accept the answer by clicking on Accept answer button. Thankyou

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.