Copy csv data from Blob Storage subfolders to SQL

Question

Hello all, I am new to Azure Data Factory. Please guide me through the following scenario:

I have a container in a storage account. Inside the container, I have multiple folders and subfolders.

For example:

Container-->Model (Multiple Folders) -->Vendor(Multiple Folders)-->ReportAccounts(Multiple Folders)-->Types(Multiple Folders)-->Client(Multiple Folders)-->Year(Multiple Folders)-->Month(Multiple Folders)-->.csv

So there will be a new file every day in Month Folder for all Models.

All I want is, when a new file is added in the folder, copy data from each subfolder and store the data in the SQL table.

I have already created tables for each Model in SQL.

Thanks in advance

Answer 1

Hi Techie,

Thank you for posting query in Microsoft Q&A Platform.

You mean to say when a file added in Month folder then automatically copy that file data to destination tables? Please confirm.

If yes, you can consider using even based triggers to achieve this. Event based triggers helps to run pipeline when any blob created or deleted based on configurations.

Please check below documentation and video to understand it better.

Create a trigger that runs a pipeline in response to a storage event

Event based Triggers in Azure Data Factory

Hope this helps. Please let me know how it goes or if any further queries.

---

Please consider hitting Accept Answer button. Accepted answers help community as well.