Azure blob storage trigger doesn't fire

Andrea Landi 6 Reputation points
2021-09-22T15:36:31.343+00:00

Hello there,
I set a storage blob trigger in Synapse. I registered the event grid, created the Trigger and associated it with a pipeline:
134229-eventgrid.png

134374-trigger.png

After saving the trigger the system shows me the files that match the blob path begin and end, so i know that everything is fine and correct.

As in the first image, the event is detected as soon as i create a blob in that path, but the trigger is not firing and my pipeline won't start:

134306-2.png
134375-3.png

134376-4.png

Am i missing something?

Thanks

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
0 comments No comments
{count} votes

3 answers

Sort by: Most helpful
  1. svijay-MSFT 5,256 Reputation points Microsoft Employee Moderator
    2021-09-23T10:08:22.483+00:00

    Hello AndreaLandi-4022,

    Thanks for the question and using MS Q&A platform.

    From your screenshots. I observe that you have configured Blob Path Filter

    134608-image.png

    I do see the there are 4 published events & no events have come under Matched events - 4 Files have been picked up but then no files have matched the filter mentioned above. Therefore, it is not delivered to the ADF.

    134661-image.png

    The below is the screenshot of the EventGrid Stats at my end.

    134596-image.png

    The matched events are 3 - meaning there are 3 files matched my filter set of 4 files that have been added. The below is my filter configuration.

    134623-image.png

    Any .txt file is uploaded - it will be under the matched events and delivered events - the delivered events are also zero.

    Coming back to your scenario. You have configured the Blob path begins with filter :

    134662-image.png

    Note : / at the end of the folder name (2018/) . You could also try adding a / at the end to your filter to get files under historical folder.

    In your case, you could upload a sample file (previously uploaded file should also work) and ensure this file comes under the Data Preview . If the file doesn't appear - you will have to tweak the filter/file-folder structure to match. If there are matched events - then there will be a trigger to the ADF

    134644-new.gif

    134692-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

  2. William Connell 1 Reputation point
    2021-09-22T19:06:57.363+00:00

    Is your Azure subscription registered with the Event Grid resource provider?

    Data Factory and Synapse pipelines natively integrate with Azure Event Grid, which lets you trigger pipelines on such events.

    Also from the image you have posted your Trigger Type is BlobEventsTrigger, and it should be Storage Event?

    https://learn.microsoft.com/en-us/azure/data-factory/how-to-create-event-trigger?tabs=data-factory

    https://www.mssqltips.com/sqlservertip/6063/create-event-based-trigger-in-azure-data-factory/


  3. HimanshuSinha 19,547 Reputation points Microsoft Employee Moderator
    2021-09-23T20:23:19.773+00:00

    Hello @Andrea Landi ,
    At this time I have no doubt that the eventgrid is working fine . Can you please let me know as to have are you testing the scenario ? I think you have blob something like
    abc/xxxxxta/historical . The ask is

    • Are you uploading a blob with the name historical_XXXX to abc/xxxxxta/ ? If not
      can you please try that out .

    I have tried a very similar sceanrio and the trigger works for me .

    134784-image.png

    Also a long shot , I see that for couple of screenshot you are in the referring the branch devnXXXXX , please make sure the trigger changes are published to the master branch to see the effect .
    134739-image.png

    Please do let me know how it goes .
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
      • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of [Q&A Volunteer Moderators][50]

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.