Error handling in API call from ADF pipeline

Pavan Kumar Chakilam 126 Reputation points
2022-02-10T21:56:53.427+00:00

I am working on one ADF pipe line which has we have to read a table using look up activity query and do for each activity for each item and all web activity by passing parameters. API may fail with various reasons and it will be successful call with different outputs.

for example:
i have to update the employees address by passing emp id and address details to API.

possible responses from API:

  1. Address updated successfully
    2)emp id not found in the system to update address

i am able to handle above cases by creating error files and output files. but not sure how to handle the below cases as API call itself failing. need an idea handle below case and complete the pipe line with success state.

some times API itself failing to call.
173199-image.png

may be other reasons to fail.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee
    2022-02-14T15:42:26.413+00:00

    Hi @Pavan Kumar Chakilam ,

    Thank you for posting query in Microsoft Q&A platform.

    Kindly try below workarounds and see if that helps.

    • Make sure using ForEach loop execution in sequence and in batch fashion. That way iterations will run in sequence and avoid errors.
      174185-image.png
    • You can consider having web activity inside Until activity and continue until loop till web activity status becomes success. Until loop inside foreach loop may not be directly supported so we can consider having different pipeline for until block and use execute pipeline activity inside Foreach activity to run same.
      Please Note, make expression in until activity to be true once web activity runs good.

    Hope this helps. Please let us know how it goes.

    --------------

    Please consider hitting Accept Answer button. Accepted answers helps community as well.


0 additional answers

Sort by: Most helpful