Datafactory delete list of files

PaoloF 1 Reputation point
2021-12-02T12:11:39.383+00:00

Hello,
I'm using a datfactory to delete some files files from a list but it's not working. ListOfFiles.txt is correctly used by the copy activity before the delete activity tries to use it so it's well formed.

Is this just bugged?

I'm deleting on a filesystem CSV dataset.

154474-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,136 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,407 Reputation points Microsoft Employee
    2021-12-03T22:55:49.503+00:00

    HI @PaoloF ,

    Thanks for using MS Q&A forum and posting your query.

    I just tested your scenario using Delete activity List of files File path type and pipeline successfully deleted this files listed in the reference file list.

    It could some configuration issue in the dataset or delete activity. Please try configuring your delete activity dataset to point to relative path of the files that needs to be deleted.

    154887-image.png

    Than in the Path to file list provide the relative path of the file that contains the list of file names to be deleted from the relative folder path provided in the dataset.

    154905-image.png

    You can also enable logging to verify what files have been deleted or other status of them in case of any error.

    154972-image.png

    Here is how the log file looks like:

    154917-image.png

    I would recommend to double check the dataset file path configuration.

    Hope this info helps. Do let us know how it goes.

    ----------

    • Please don't forget to click on 130616-image.png and upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators