Saving the output from a execute Pipeline activity to a blob storage or a sql table in ADF

Sampath S 81 Reputation points
2022-10-02T07:58:42.723+00:00

I am using a scheduled trigger.
I want to save the output log from every execute pipeline activities to a blob storage or a sql table.
How can I do that?
The output should be saved to blob or table when ever the pipeline is success or failure with error message and details.
Can some one guide me?

@Suba Balaji

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,777 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 38,286 Reputation points Microsoft Employee
    2022-10-06T14:42:41.72+00:00

    Hi @Sampath S ,

    Thank you for posting query in Microsoft Q&A Platform. Let me share detailed steps here so that helps you to understand implementation details better.

    In below Image, MainPipeline is the pipeline which actually runs my child pipeline using Execute Pipeline activity. I named my Execute Pipeline activity as ChildPipeline. Hence In all expressions You see ChildPipline as activity name. In your case when writing expressions kindly use your execute pipeline activity name accordingly.

    ![248127-image.png

    Please check below video that explains how stored procedure activity will work also how to get error details and other details from an activity using expressions for better understanding.
    Log Pipeline Executions to SQL Table using Azure Data Factory
    Get Error message of Failed activities in Pipeline in Azure Data Factory

    Hope this helps. Please let me know if any further queries.


    Please consider hitting Accept Answer and Up-Vote buttons. Accepted answers help community as well.

    4 people found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Suba Balaji 11,191 Reputation points
    2022-10-02T08:44:35.863+00:00

    Please check this blog url. It has the detailed steps with table design.

    Please let us know if it helps.

    Also a request to you, to add additional details of question in comment section instead of answer section as it might affect the question reach

    1 person found this answer helpful.