Access all files from folder and subfolders in blob storage

Luis Gustavo Martinez Osorio 5 Reputation points
2023-09-08T12:54:05.85+00:00

Hi everybody,

I have an especific situation, I have a folder with lots of other subfolders and in each subfolder I have different .txt files, I need to build a pipeline that take each file from each subfolder and send them accros a data flow that I already have.

Please, someone can help me with this.

Thank you.

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,415 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,483 questions
{count} vote

1 answer

Sort by: Most helpful
  1. Nandan Hegde 29,886 Reputation points MVP
    2023-09-08T13:23:04.3366667+00:00

    Hey,

    Below blog should help :

    https://datasharkx.wordpress.com/2023/02/06/calculate-folder-size-of-an-azure-blob-storage-data-lake-storage-via-synapse-data-factory-pipeline/

    rather than calculating the size, you can make use another activity w.r.t the iteration file