Azure blob storage trigger doesn't work

Mike Xu 0 Reputation points
2023-09-01T22:06:19.16+00:00

I'm trying to create a event trigger for a pipeline. The trigger should be whenever the files in the below folder are created, and they are updated mostly everyday.

all the files in the folder have the same name except the endings are like 0-1, 0-10, 0-11, etc as shown below. I was set it up as choosing the 0-1.parquet file as the trigger.User's image

The trigger of the pipeline I created is shown below, but it's not working. Can you please help me see if I set it up wrong? Thank you!

User's image

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
{count} votes

1 answer

Sort by: Most helpful
  1. Ramya Harinarthini_MSFT 5,361 Reputation points Microsoft Employee Moderator
    2023-09-04T10:36:11.3433333+00:00

    Mike Xu

    We have tried to test the blob events triggers on of my test storage account.

    Created a test storage account and container name "pranathi" created directory "testdir" and uploaded blobs with 0-1.parquet

    User's image

    Now create Data Factory pipeline as below with blob path name ends with 0-1.parquet filter

    Please provide the container name as /containername/ as shown in the below screenshotUser's image

    In the data preview section i could see the 2 blobs are matching

    User's image

    Make sure to "Publish" for trigger to be activated after clicking "OK"

    User's image

    Now uploaded a new file Siva0-1.paraquet at 3:43pm IST

    User's image

    From the pipeline run could see a new event at the same time 3:43pm IST.

    User's image

    When you click on trigger runs you can see it ran for same trigger file name Siva0-1.parquet

    User's image

    Navigate to the Storage account -->Events -->select event subscription and see whether is it showing any matching events or any Delivery failed events

    User's image

    Also make sure the all the event type and Subjected filters are showing same which you have configured in pipeline and also please ensure you have all the Advanced filters as shown in the below screenshot.

    Reference Article :https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blob-event-overview#practices-for-consuming-events

    If you want to ensure that the Microsoft.Storage.BlobCreated event is triggered only when a Block Blob is completely committed, filter the event for the CopyBlob, PutBlob, PutBlockList or FlushWithClose REST API calls. These API calls trigger the Microsoft.Storage.BlobCreated event only after data is fully committed to a Block Blob. To learn how to create a filter, see Filter events for Event Grid.

    User's image

    I have tried this, and it worked so please let us know if it worked for you.

    Kindly let us know if the above helps or you need further assistance on this issue.


    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helpsyou, this can be beneficial to other community members.

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.