ADF Activity Failure path not getting executed completely

Question

I have a simple ADF pipeline with requirements like this:

Req 1 (Success of Activity A'): 'Activity A' -> 'Activity B' -> 'If_Activity_Check_fail_flag' (On Success of 'Activity A': execute 'Activity B' and bypass 'If_Activity_Check_fail_flag' activity )

Req 2 (Failure of Activity A'): 'Activity A' -> 'setVar' activity (set fail_flag=true) -> 'Activity B' -> 'If_Activity_Check_fail_flag' (On failure of 'Activity A': set fail_flag=true ,execute 'Activity B' activity , execute 'If_Activity_Check_fail_flag' activity and FAIL, )

Within the 'If_Activity_Check_fail_flag' activity there is a 'FAIL' activity (if fail_flag=true)

Req1: I have built it and the pipeline succeeded (both 'Activity A' and 'Activity B' succeeded and 'If_Activity_Check_fail_flag' activity doesn't execute).

Req2: I have built it, but while executing if 'Activity A' fails then the 'setVar' activity is executed but after that the 'Activity B' and 'If_Activity_Check_fail_flag' activities don't execute and the pipeline succeeds.

Can anyone please help for Req2? For Req2 I want after 'setVar' activity is executed (after 'Activity A' fails), the 'Activity B' and 'If_Activity_Check_fail_flag' activities should also execute.

Thanks,

Answer 1

Given below is the pictorial representation of the issue

Answer 2

Hey,
The reason is Activity B would be executed if
Activity A is success AND Activity 'Set variable' is Success based on the flow chart that you have created.

Its because that scenario is never possible, this flow would never proceed.

So in order for you to achieve your use case, you need to add some additional flows as below:

From Activity A to Activity B , add 'On Completion flow'
From Set Variable activity to Activity B , add 'on Skip flow'

Below blog highlights some scenarios of flows :
https://datasharkx.wordpress.com/2021/08/19/error-logging-and-the-art-of-avoiding-redundant-activities-in-azure-data-factory/