hi fail for calling falure activity

Karnati, Venkata Suchendra Reddy (DXC Luxoft) 6

Hi team

i have to run a web activity incase if previos actvity got fail. i have connected through failure conection when ever it gets fails its not triggering failure activity.

when failed it fails to call web activity for emails

above 2 pics will helps you to understand. i observed this kind of issue with other pipeline too.

Karnati, Venkata Suchendra Reddy (DXC Luxoft) 6 Reputation points

2022-02-01T13:49:19.097+00:00

Could you please help me to fix this
AnnuKumari-MSFT 30,676 Reputation points Microsoft Employee

2022-02-01T13:53:52.38+00:00

Hi @Karnati, Venkata Suchendra Reddy (DXC Luxoft) ,
Could you please confirm if the copy activity is having retry count >0 . In that case, it will go through all the retry attempts first until it fails completely after all the attempts , then only it will trigger the next activity linked via failure connection.
Karnati, Venkata Suchendra Reddy (DXC Luxoft) 6 Reputation points

2022-02-01T14:01:10.093+00:00

HI Annu Kumari, @AnnuKumari-MSFT

yes it has retry count is 1, and also having retry interval. could you please elabarate to fix this issue.

this copy activity inside for each. i am calling almost 15 api to csv files. what kind of setting do i need to change.
AnnuKumari-MSFT 30,676 Reputation points Microsoft Employee

2022-02-09T09:44:23.003+00:00

Hi @Karnati, Venkata Suchendra Reddy (DXC Luxoft) ,
Following up to see if the above suggestion was helpful, kindly do click Accept Answer and Up-Vote for the same. In case you have any further query please do let us know.

1 answer

AnnuKumari-MSFT 30,676 Reputation points Microsoft Employee

2022-02-01T14:11:01.177+00:00
Hi @Karnati, Venkata Suchendra Reddy (DXC Luxoft) ,
Thankyou for using Microsoft Q&A platform and posting your question.

Also, Thanks for confirming copy activity has retry count as 1 with retry interval 840 secs(14mins) which means if any instance of copy activity fails, that particular instance will go for a second attempt once more after 14mins. Now, if the second attempt is successful , it will not trigger web activity as the final output is a success. Simplest way to test web activity gets triggered after failure of copy activity or not is to set retry count to 0 and run the pipeline.

According to me , pipeline looks fine and it should trigger the web activity . Please do let us know the outcomes after retry =0 . If web activity is triggered , it means at the second attempt , copy activity is succeeding. That is the reason, web activity is not getting triggered.

Hope this will help. Please let us know if any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.
Original posters help the community find answers faster by identifying the correct answer. Here is how

Want a reminder to come back and check responses? Here is how to subscribe to a notification

If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
Please sign in to rate this answer.

1 person found this answer helpful.
Karnati, Venkata Suchendra Reddy (DXC Luxoft) 6 Reputation points

2022-02-01T14:29:55.14+00:00

Hi @AnnuKumari-MSFT

Thanks for you are explanation!!

query : even after 2 interval or 3 interval or 4 .... if copy activity fails its has to trigger failure connection (web activity), here its not happening.

could you please validate this point.

AnnuKumari-MSFT 30,676 Reputation points Microsoft Employee

2022-02-02T17:53:19.267+00:00

Hi @Karnati, Venkata Suchendra Reddy (DXC Luxoft) ,
Could you please let me know what happened when you tried to run the pipeline with retry count =0 . Did it not trigger the web activity after failure of copy activity? As I suspect due to retrial copy activity was successful in second attempt.

I tried to repro your scenario . I did not get any issue like this. I used Copy activity and forcefully failed it (with retry count=1) and called a web activity after the failure inside a ForEach block. Post a failed copy activity, my web activity was triggered successfully.

Here is the screenshot of the same.

If this answers your query, do click Accept Answer and Up-Vote for the same as accepted answer helps the community as well. And, if you have any further query do let us know.

As it doesn't look like a global issue , I would suggest you to create a support ticket with Microsoft Azure. To get more details on how to create a support ticket, please go through the following article: Create an Azure support request

Karnati, Venkata Suchendra Reddy (DXC Luxoft) 6 Reputation points

2022-02-03T01:03:13.88+00:00

Hi With retry 0 iam getting web activity fired sucessfully but. i cant chage count =0 i have 2 try 2 or 3 time to make copy success since its is a APi Call

AnnuKumari-MSFT 30,676 Reputation points Microsoft Employee

2022-02-03T12:18:14.403+00:00

@Karnati, Venkata Suchendra Reddy (DXC Luxoft) ,
Thanks for the confirmation that with retry=0 Web activity is getting triggered. As per my understanding , there is no issue with the pipeline even with retry>0 .
Let's say , inside forEach block , there are 3 copy activity instances supposed to get executed. First one failed, second one succeeded, third one failed. Now, first instance will go for retry and succeeded . Then, third instance also went for second attempt and succeeded. In this way, although you see in your output that two copy activities have failed but it's actually not the same instances . It's first attempt of different instance that has failed.

You can use annotation to parameterize each instances and get details on which instance succeeded and which one failed.

Here are few links that will help you to get more details on how to use annotation in pipeline:
https://www.cathrinewilhelmsen.net/annotations-user-properties-azure-data-factory/
https://learn.microsoft.com/en-us/shows/azure-friday/enhanced-monitoring-capabilities-and-tagsannotations-in-azure-data-factory

If you still have any further question on how to use annotation , feel free to post a new query.
Hope this will help. Kindly do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

AnnuKumari-MSFT 30,676 Reputation points Microsoft Employee

2022-02-04T05:07:52.72+00:00

Hi @Karnati, Venkata Suchendra Reddy (DXC Luxoft) ,
Just checking in to see if the above suggestion helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.
Sign in to comment