ADF dataflow

Question

Hi,

I have 4 big files to load to a snowflake table that are on blob storage. My pipeline has Get Metadata task to read the file names and ForEach to loop though the files, but inside ForEach I'm using DataFlow instead of copy task because I want to load the name of the file into my table. How do I pass file name into data flow? Is there another way to accomplish this? I started using ADF just a couple of months ago, so your inputs are really appreciated.

Thanks,
Anu

Answer 1

Hi @Anu Chandra ,

you can use CopyActivity instead of the DataFlow and save FilePath, not the fileName. Please see the below link for details. Thank you!

https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-overview#add-additional-columns-during-copy