Access all files from folder and subfolders in blob storage

Luis Gustavo Martinez Osorio 5 Reputation points
2023-09-08T12:54:05.85+00:00

Hi everybody,

I have an especific situation, I have a folder with lots of other subfolders and in each subfolder I have different .txt files, I need to build a pipeline that take each file from each subfolder and send them accros a data flow that I already have.

Please, someone can help me with this.

Thank you.

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,202 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,658 questions
{count} vote

1 answer

Sort by: Most helpful
  1. Nandan Hegde 36,156 Reputation points MVP Volunteer Moderator
    2023-09-08T13:23:04.3366667+00:00

    Hey,

    Below blog should help :

    https://datasharkx.wordpress.com/2023/02/06/calculate-folder-size-of-an-azure-blob-storage-data-lake-storage-via-synapse-data-factory-pipeline/

    rather than calculating the size, you can make use another activity w.r.t the iteration file


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.