How do I add a new string to the folder name? - Azure Synapse Analytics

Kakehi Shunya (筧 隼弥) 201 Reputation points
2022-07-07T06:57:08.23+00:00

I would like to add a new string to the Blob folder name when bulk copying data from S3 to Azure Blob Storage.

The folder structure of S3 is shown in the following picture
Folder Name/yyyy/mm/dd/files.

218437-image.png

I would like to copy it to Blob like this
Folder Name/year=yyyyyy/month=mm/day=dd/files

I don't know how to do this, but the deadline for this project is near and I am stumped.

Please can someone please answer me as soon as possible.
Any answer would be appreciated.
Thank you.

Translated with www.DeepL.com/Translator (free version)

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,436 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,395 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,599 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. ShaikMaheer-MSFT 37,896 Reputation points Microsoft Employee
    2022-07-22T09:22:33.373+00:00

    Hi @Kakehi Shunya (筧 隼弥) ,

    Thanks for posting query in Microsoft Q&A Platform and thanks for sharing details of your dataset configurations.

    If we want to have paths to be created dynamically in Sink storage as per our desired naming then make sure to parameterize your sink dataset and then please values to that dataset parameters as per requirement.

    Kindly check below video to understand how to parameterize datasets in Azure data factory.
    Parameterize Datasets in Azure Data Factory

    Hope this helps. Please let us know how it goes. Please let us know still if any further queries.

    ----------------

    Please consider hitting Accept Answer and Up-vote. Accepted answers help community as well.