How to send multiple files from event base trigger

Question

Hello Team,

I Hope your are doing great !!!

Could you please let me know is there any way to send multiple files from storage using event base trigger.
eg: now 5 files are added to my storage account event trigger is triggering 5 times, to avoid this i need to trigger one time after all files are added to source that to with event base only.

if you help it would be great.

Thanks,
Mahesh

Answer 1

Hey,
Any reason why you are mapping your event trigger to the original path source where all files are being created and uploaded ? Cant you create a dummy blob path at the end with a dummy file to have a final trigger once all files are uploaded to overcome this issue?
note: You can get the count of files via meta data activity

note: this is how we manage this :) but there is a redundant file generated unfortunately

Answer 2

Hi @Anonymous ,

Thank you for posting query in Microsoft Q&A Platform.

Event based trigger will actually trigger pipeline for every event. That means, when a file landed to storage then it's an event and for that event it's going to run pipeline. Hence for 5 files landing you are seeing 5 executions. Each execution with for each file.

So for sure, Event based trigger cannot wait for 5 files to land and trigger all of them as single execution.

You can consider using normal trigger (schedule or tumbling window) and implement pipeline in such a way that it can take all 5 files and load it sink.

Hope this helps.

----------------

Please consider hitting Accept Answer button. Accepted answers help community as well.