Hi Jay Remally,
Thanks for reaching out to Microsoft Q&A.
to copy csv files from nested folders in adf while preserving the hierarchy, you can try the below steps:
- Source Dataset Configuration:
- Create a source dataset that points to your root folder containing the nested subfolders.
- Set the wildcard file path property to ".csv" to read only CSV files.
- Set the recursive property to "true" to include files from all subfolders.
- Copy Activity Configuration:
- Create a Copy Data activity in your ADF pipeline.
- Use the source dataset created in above step.
- Configure the sink dataset to write the data to the desired destination (ex: blob storage, SQL db, datalake, etc.).
- Set the sink folder structure to match the source folder hierarchy. This will preserve the nested subfolder structure.
Please 'Upvote'(Thumbs-up) and 'Accept' as an answer if the reply was helpful. This will benefit other community members who face the same issue.