Unable to copy files from latest folder in pipeline

2022-10-18T04:30:35.44+00:00

Hi Team,

The source folder has muiltiple sub folders and each sub folder has multiple zip files. I have built a pipeline that sorts the latest sub folder using variable method.

The pipeline path follows as below.

Step 1: Create variables (latest modified and previous modified) --> Get Metadata (of main folder) --> For each loop
Step 2: In For each loop --> Get Metadata (child items of Step1 Metadata) --> Set Variables that filter out the latest file by comparing with previous file
Step 3: Copy the latest folder

However, I am unable to read through the files in sub folder and copy.
Can you please help?

Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,930 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha-msft 19,386 Reputation points Microsoft Employee
    2022-10-18T19:24:22.62+00:00

    Hello @SINGEETHAM PRASANNAKRISHNA (MS/EAV3-PS) ,

    Thanks for the question and using MS Q&A platform.
    As we understand the ask here is to copy the files from a sub-folder and i am asssuming that you are not getting nay error but then the files are not getting copied , please do let us know if its not accurate.

    One thing which i want you to check if you have set the ItemType to File and not folder .

    https://learn.microsoft.com/en-us/azure/data-factory/control-flow-get-metadata-activity#metadata-options

    251646-image.png

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments