Share via

API via Web Activity

Rohit Kulkarni 731 Reputation points
2022-02-08T09:20:40.167+00:00

Hello Team,

I am calling API via Web Activity and wants to transfer the data to Blob storage in CSV format.

Pipeline :
172186-image.png

Error Message :
172187-image.png

Blob Output :

172157-image.png

URL :https://storagename.blob.core.windows.net/Warehouse/EmployeDetails.csv

Please advise how this issue can be resolved

Regards
Rk

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.


1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,161 Reputation points
    2022-02-09T22:00:51.933+00:00

    Welcome back @Rohit Kulkarni .

    As I understand the ask, you are using Web Activity to do blob operations, and are getting unexpected errors, and want to know what might be the cause.

    It looks like you are using a PUT on a blob, but somehow getting 404 not found. For writing normal block blobs, this shouldn't happen because putting a blob should create it. So, I am looking into what combination could result in 404. There are several other operations which also use the PUT verb on a blob. They typically take the form of adding ?comp={operation} to the URL, and generally require the blob already exist. Some examples are:

    https://myaccount.blob.core.windows.net/mycontainer/myblob?comp=properties
    https://myaccount.blob.core.windows.net/mycontainer/myblob?comp=metadata
    https://myaccount.blob.core.windows.net/mycontainer/myblob?comp=tags
    https://myaccount.blob.core.windows.net/mycontainer/myblob?comp=tier

    If there is no ?comp= after your URL, there are still a couple possibilities. The Copy Blob operation and the put blob from url operation, which looks like a normal put block, except for the addition of the header x-ms-copy-source:name. They need a source, so 404 might happen when source url has a typo.

    Another option is to use Copy activity with HTTP dataset instead of multiple web activities.

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.