Azure Data Factory Trigger Storage Event Error 404 - The Required Blob is Missing

Question

I have setup a storage event Trigger in ADF using this documentation (https://learn.microsoft.com/en-us/azure/data-factory/how-to-create-event-trigger?tabs=data-factory)

To put it simply, I want it to trigger a copy data/file upon a new blob being created (e.g /processed/XXXX-Data.csv) and then copy to another blob folder (/archived/XXXX-Data.csv)

However when I test the trigger I get this error. Both the [STORAGEACCOUNTNAME] & [FOLDER] paths are correct but not the filename.

This works fine if I enter the actual filename in the Trigger Run Parameters itself.

Operation on target Processed to Archived failed: ErrorCode=UserErrorSourceBlobNotExist,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The required Blob is missing. ContainerName: https://[STORAGEACCOUNTNAME].blob.core.windows.net/[FOLDER], path: @triggerBody().fileName.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.WindowsAzure.Storage.StorageException,Message=The remote server returned an error: (404) Not Found.,Source=Microsoft.WindowsAzure.Storage,StorageExtendedMessage=RequestId:93d995c9-101e-004f-

I have tried both @triggerBody().fileName & @Trigger ().outputs.body.fileName yet receiving the same issue. It's like the system does not recognise that it is dynamic content. Am I missing something really simple here?

Thanks

J

Answer 1

Hello @Jonny M ,

Thanks for the question and using MS Q&A platform.

Just to summarize your problem - you are receiving the above error when you try to manually trigger the pipeline that is attached to a storage event trigger configured to your source blob folder and if you manually provide the file name in trigger parameter value it works fine. Please correct if my understanding is not accurate.

The above error message is thrown when the required blob name is not received by your pipeline data set. Since you are manually testing the pipeline it won't have a file name which is why you might be getting this error. In order to test your storage event trigger you will have to manually/automatically drop a file in the folder for which your storage event trigger is configured or looking for. When the blob is dropped to your source folder the events get fired and the trigger is executed and the folderPath and fileName as passed from your trigger properties to your pipeline parameters and from there to your dataset parameters and your pipeline executes without issues.

Please make sure that your event trigger is configured to the correct source folder and the trigger parameters should be as shown below:

Would recommend to double check your trigger configuration as well as your dataset configuration to make sure both are pointing to the same source folder path.

Pipeline Parameters:

Dataset parameters:

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators