How Iterate Each date hierarchy Folder File by passed Date Parameter filter

Ajith 1 Reputation point
2021-05-02T14:51:04.247+00:00

I have 2 yrs back data in blob storage and Data is stored in Date Hierarchy Structure like Year folder then month folder and then Day folder in blob storage, how can we loop through and load into sql table.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,138 questions
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,407 Reputation points Microsoft Employee
    2021-05-05T18:37:46.043+00:00

    Hi @Ajith ,

    Following up as we still have not heard back from you.

    But in general In order to loop through the date folders, you can follow similar approach explained in this thread where the user also has a requirement to loop through YYYY/MM/DD folder and copy those files : Accessing file name from nested folder structure and passing it to Notebook activity as a parameter in ADF.

    Hope this helps. In case if you still need assistance do let us know.

    Thank you

    ----------

    Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments