UserErrorSourceBlobNotExist - No file/data to Load

MaGr 96 Reputation points
2021-01-20T16:21:12.403+00:00

Hi,

A copy activity is configured to extract data from the DataLake to the first layer in Synapse. The activity is set up with PolyBase in Sink side with staging funcionality due to the load was set up with Wildcard file path.

COPY ACTIVITY CONFIGURATION:
![![58746-image.png
58802-image.png
58782-image.png

Due to there are not new data in the delta, load files are 0 , in that case no data is added in BlobStorage (Staging) and the process is [SUCCEEDED] , but then when the activity try to copy the data from BlobStorage (Staging) to Synapse the result is [FAIL]. And the error is the following one.

58734-image.png

Operation on target CopyActivity1 failed: ErrorCode=UserErrorSourceBlobNotExist,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The required Blob is missing. Folder path: stagingpolybasetmp/8166f184-a2c6-4c57-a078-981d2d31a53f/Polybase/.,Source=Microsoft.DataTransfer.ClientLibrary,'

NOTE: The process is OK if there are delta data.

Does anyone know what is happening and could you tell me the possible solution?

Thank you in advance,

MG

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,740 questions
{count} votes

Accepted answer
  1. MaGr 96 Reputation points
    2021-01-22T11:17:21.25+00:00

    SOLVED

    A Metadata activity and If avtivity was added in the pipeline in order to execute or not the copy activity.

    It is very odd to do that. It should be correct in future versions, because of is an usual behaivour to have no data in a delta extractions.

    If expression: @hamed1374 (empty(activity('New Data File').output.childItems))
    59584-image.png


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.