Event Trigger On Synapse Not Working When The File Uploaded Manually

Question

Event Trigger On Synapse Not Working When The File Uploaded Manually

Rodliatum Mardliyyah 6

Hai,
I have been trying to create an Event based Trigger and have attached it to a pipeline. Now, what is happening is when I upload a file of the format of the blob path specified through the Synapse UI manually, the trigger is not working.
I'm using ADLS Gen 2.

But,
When I use Azure Blob Storage (not ADLS Gen 2), the trigger is work fine.

Please anybody help..

Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-11-11T23:04:11.457+00:00

Hi @Rodliatum Mardliyyah ,

Thanks for using Microsoft Q&A !!

I have tested this in my environment using ADLS Gen2 Storage account and it works as expected and uploading a file triggered the pipeline.
Can you please share what settings you are using against - "Blob path begins with" and "Blob path ends with" properties while creating the event trigger as your storage event trigger requires at least one of these properties to be defined.

Please refer to the documentation Create a trigger that runs a pipeline in response to a storage event

Thanks
Saurabh
Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-11-16T21:17:03.257+00:00

Hi @Rodliatum Mardliyyah ,
Following up to know if you are still having this issue.

Thanks
Saurabh
Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-11-29T22:54:13.16+00:00

Hi @Rodliatum Mardliyyah ,

We haven't heard back from you. Just wanted to check if you are you still facing the issue? In case If you already found a solution, would you please share it here with the community? Otherwise, let us know and we will continue to engage with you on the issue.

Thanks
Saurabh
Rodliatum Mardliyyah 6 Reputation points

2021-11-30T01:51:15.417+00:00

I'm still facing the same issue.
am I missing some RBAC setting?
Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-12-08T01:13:32.51+00:00

Hi @Rodliatum Mardliyyah ,
Please open a support case so that someone could look into your environment.

Thanks
Saurabh
Amandeep Bhupal 0 Reputation points Microsoft Employee

2023-03-07T16:02:58.9233333+00:00

Hi,
I am facing the same issue.

My Synapse pipeline has one notebook. I have a trigger set up with the pipeline - which is storage event trigger and the pipeline is not triggering if a new entry is made in the delta_log folder.

Who could I raise a ticket with? Or is there a solution available ?

3 answers

Your answer

Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-11-11T23:04:11.457+00:00

Hi @Rodliatum Mardliyyah ,

Thanks for using Microsoft Q&A !!

I have tested this in my environment using ADLS Gen2 Storage account and it works as expected and uploading a file triggered the pipeline.
Can you please share what settings you are using against - "Blob path begins with" and "Blob path ends with" properties while creating the event trigger as your storage event trigger requires at least one of these properties to be defined.

Please refer to the documentation Create a trigger that runs a pipeline in response to a storage event

Thanks
Saurabh
Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-11-16T21:17:03.257+00:00

Hi @Rodliatum Mardliyyah ,
Following up to know if you are still having this issue.

Thanks
Saurabh
Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-11-29T22:54:13.16+00:00

Hi @Rodliatum Mardliyyah ,

We haven't heard back from you. Just wanted to check if you are you still facing the issue? In case If you already found a solution, would you please share it here with the community? Otherwise, let us know and we will continue to engage with you on the issue.

Thanks
Saurabh
Rodliatum Mardliyyah 6 Reputation points

2021-11-30T01:51:15.417+00:00

I'm still facing the same issue.
am I missing some RBAC setting?
Saurabh Sharma 23,846 Reputation points Microsoft Employee Moderator

2021-12-08T01:13:32.51+00:00

Hi @Rodliatum Mardliyyah ,
Please open a support case so that someone could look into your environment.

Thanks
Saurabh
Amandeep Bhupal 0 Reputation points Microsoft Employee

2023-03-07T16:02:58.9233333+00:00

Hi,
I am facing the same issue.

My Synapse pipeline has one notebook. I have a trigger set up with the pipeline - which is storage event trigger and the pipeline is not triggering if a new entry is made in the delta_log folder.

Who could I raise a ticket with? Or is there a solution available ?

Answer 1

Paramesh G 6

Hi @Rodliatum Mardliyyah

Did this issue get resolved ?

I'm facing the same issue. Mine is very straight forward.
Created a pipeline which calls synapse notebook that transforms json to parquet. On top of the pipeline, created an event based trigger for triggering the pipeline as and when the blob gets uploaded to Gen2.

Rodliatum Mardliyyah 6 Reputation points

2022-04-08T04:09:43.113+00:00

Hi..
No, I still have no solution for this issue.
What I did is create new regular storage.

Answer 2

Joshua Blanco 1

Hi, I'm facing the same issue.

When I upload the file from the Azure Storage Explorer, the trigger works fine, but when I try to upload the file from the Synapse workspace into the ADLS Gen 2, the trigger doesn't work.

Answer 3

Rodliatum Mardliyyah 6

Halo everyone, sorry for late response.

It has been long time ago, and I'm sorry i can't remember the solution.

But, from I remember, at the end, I didn't use the upload manually.

Share via

Event Trigger On Synapse Not Working When The File Uploaded Manually

3 answers

Your answer