ADF Copy - Path to file list

Question

I am trying to copy files based on list of files in a text file. I dont know why I am getting path error despite having provided correct path. The copy is getting failed everytime, any help will be appreciated.

ErrorCode=UserErrorFileNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=,Source=,''Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ADLS Gen2 operation failed for: Operation returned an invalid status code 'NotFound'. Account: 'copy2synapseadlsgn2'. FileSystem: 's3files'. Path: 'xxxxxxxxxxxxxxxxx.zip/Listoffiles.txt'. ErrorCode: 'PathNotFound'. Message: 'The specified path does not exist.'. RequestId: 'c86e4957-801f-0005-6902-00097e000000'. TimeStamp: 'Thu, 24 Nov 2022 12:43:26

Answer 1

Hi @Vinodh247

The error states the path "synapse/FILE1" It's looking for FILE1 in this path, but the actual path in the screenshot is the one with .zip in the folder name, That might be the reason for the error. Check the source dataset directory, what is getting passed or is given there.

Something like this. The file mention in ListofFile will by default look into the path given in the dataset.

Hope this might help you.

Answer 2

Hi @Vinodh247 ,

Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

It seems ADF is not able to recognize the specified filepath in copy activity. Please let me know if my understanding is incorrect.

When using listoffiles in FilePathType of Copy activity , you can only copy files present in the same folder where the file containing the list of filenames is present.

For example: Suppose container1 contains : file1.csv,file2.csv and lisoffiles.txt
container2 contains : file3.csv,file4.csv

If you provide filenames : 'file3.csv','file4.csv' in the listoffiles.txt , it will fail stating specified path does not exist.
Kindly make sure you are providing 'file1.csv' or/and 'file2.csv' in the 'listoffiles.txt'

For more details, kindly check out: ADF Copy List Of Files Feature | copy from one blob container to another

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators