Azure Data Factory API Copy Activity Fails with 'Rest Call Failed with Client Error' for ZIP Archive

Question

Azure Data Factory API Copy Activity Fails with 'Rest Call Failed with Client Error' for ZIP Archive

Anonymous

Hello,

I am trying to copy data from an API that gives a zip archive of multiple json files. Using Data Factory in Fabric, I generate a OAuth2.0 token and give the appropriate credentials in the additional header of the copy activity.

However, the copy activity gives the following error:

Failure happened on 'Source' side. ErrorCode=RestCallFailedWithClientError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Rest call failed with client error, status code 404 NotFound, please check your activity settings.
Response: {"timeStamp":"2024-11-22T03:56:38.979780874Z","status":404,"error":"Not Found","message":"No handler found for GET <

Chandra Boorla 15,470 Reputation points Microsoft External Staff Moderator

2024-11-22T17:36:34.45+00:00

Hi @Basile MAILLE

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

Could you please share more details on configurations of your copy activity. Appreciate if you could share the screenshot this will help us to understand the error and guide you in better way. And also, please try the same in postman and see if API call is successful.
Chandra Boorla 15,470 Reputation points Microsoft External Staff Moderator

2024-11-25T01:18:06.6633333+00:00

@Basile MAILLE

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Anonymous

2024-11-25T03:02:58.63+00:00
The problem still persists. The API I am getting data from works in several steps:

Get the OAuth2.0 access token

Start the request so the API prepares the files, it will respond with an URL to the request status

This request may takes some time so I wait until it gives out a tag "DONE"

Once "DONE", it will finally give a download link for a zip archive

The pipeline is set up as follows:

For some reason, my first post didn't include me saying that I did test using the same input as Copy data1 on Postman and that the file was succesfully downloaded

I haven't found this error code being mentionned on the microsoft learn troubleshooting list
Chandra Boorla 15,470 Reputation points Microsoft External Staff Moderator

2024-11-26T10:25:08.92+00:00
@Basile MAILLE

It seems that you are experiencing a 'Rest Call Failed with Client Error' when trying to copy data from an API that returns a ZIP archive using Azure Data Factory. While the specific error code is not mentioned in the troubleshooting documentation, there are a few common issues that could cause this problem:

Authentication Issues:

Ensure that the OAuth2.0 token is being generated correctly and is valid. If the token is expired or not properly included in the headers, it could lead to client errors.

URL Accessibility:

Verify that the URL provided for downloading the ZIP archive is accessible from the Azure Data Factory environment. If the URL is a localhost or internal network address, it may not be reachable.

Payload Size:

If the ZIP archive is too large, it might exceed the maximum payload size supported by Azure Data Factory. The maximum supported output response payload size is around 4 MB. If your ZIP file exceeds this limit, consider breaking it into smaller parts.

Concurrent Executions:

If there are too many concurrent executions of activities, it may lead to throttling issues. Reducing the number of concurrent executions may help.

Error Handling:

Implement error handling in your pipeline to capture and log the specific error details. This can provide more context on what might be going wrong.

For additional information, please refer: https://learn.microsoft.com/en-us/azure/data-factory/data-factory-troubleshoot-guide#web-activity

If the issue still persists, please do let us know.

I hope this information helps.

Thank you.
Chandra Boorla 15,470 Reputation points Microsoft External Staff Moderator

2024-11-27T08:04:58.2433333+00:00

@Basile MAILLE

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thank you.
Chandra Boorla 15,470 Reputation points Microsoft External Staff Moderator

2024-11-28T10:08:31.59+00:00

@Basile MAILLE

Following up to see on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thank you.