audit table

Question

audit table

Vineet S 1,390

Hi,

how to set a up a audit log table in in adf pipeline.... i know single copy activity can be logged using sp for failure and success but how about multiple copy activity or any other activity failed

have tried below for single copy activity

https://www.youtube.com/watch?v=rEU7itAr3J8

Chandra Boorla 15,455 Reputation points Microsoft External Staff Moderator

2024-11-25T12:03:41.7733333+00:00

@Vineet S

Just checking in to see if the below answer provided by @ Nandan Hegde helped.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

Chandra Boorla 15,455 Reputation points Microsoft External Staff Moderator

2024-11-25T12:03:41.7733333+00:00

@Vineet S

Just checking in to see if the below answer provided by @ Nandan Hegde helped.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

Nandan Hegde 36,716 MVP Volunteer Moderator

Below Blog provides detailed aspect for copy activity logging :

https://www.mssqltips.com/sqlservertip/6320/logging-azure-data-factory-pipeline-audit-data/

But in general if you want to log for all activities their failure msgs etc, plz follow the below blog to have a customized approach :

https://datasharkx.wordpress.com/2021/08/19/error-logging-and-the-art-of-avoiding-redundant-activities-in-azure-data-factory/

Vineet S 1,390 Reputation points

2024-11-22T01:51:42.9866667+00:00

Any screenshot pls
Nandan Hegde 36,716 Reputation points MVP Volunteer Moderator

2024-11-22T03:21:44.88+00:00

Plz refer the blogs (they have step by step details with all images/screenshots )

reference :
Vineet S 1,390 Reputation points

2024-11-25T16:26:21.49+00:00

What is the logic for it for multiple activities in one pipeline only one condition like on failure, on success will work?
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Smaran Thoomu 32,530 Reputation points Microsoft External Staff Moderator

2024-11-28T05:38:12.5366667+00:00

Hi @Vineet S

Regarding your question on setting up an audit log table in ADF pipeline, you can refer to the following resources:

For logging copy activity, you can use stored procedures to log success and failure messages. You can refer to this video tutorial for more information: https://www.youtube.com/watch?v=rEU7itAr3J8

For logging all activities, you can follow a customized approach as described in this blog post: https://datasharkx.wordpress.com/2021/08/19/error-logging-and-the-art-of-avoiding-redundant-activities-in-azure-data-factory/

Regarding your question on the logic for multiple activities in one pipeline, you can use the same condition like on failure or on success for all activities in the pipeline. However, you can also use different conditions for different activities based on your specific requirements. For example, you can use on completion for some activities and on failure for others. It depends on what you want to achieve with your pipeline.

I hope this helps! Let me know if you have any further questions.

Share via

audit table

1 answer

Your answer