how to log a list of files passed to delete activity into a new file stating if file is deleted or not

Question

I have 100 files in a container ,I want to delete only 10 files . So I used filter activity ,as output of filter activity I am getting 12 files names . That 12 list of files I am passing to deletes activity and put last modified date condition over there so only 10 files are getting deleted .

Now I want to log these 12 files name in single log file stating which files are deleted and which are not.

I tried to use "logging setting" of delete activity but it is creating multiple log files, one for each file name passed to delete activity. I think this is because I am using delete activity inside for each.

Here is snippet of my pipeline.

Answer 1

Hi Gulhasan.Siddiquee ,

Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

As I understand your query, you are trying to delete only few selected files from the folder. Please let me know if my understanding is incorrect about the query.

Instead of iterating through the files that you want to delete, you can either use 'wildcard file pattern' to delete the files in case your filenames which you want to delete shares a common pattern , or else, if the filenames doesn't have any matching pattern, you can use 'list of files' option where you need to point to a file which contains all the filenames you want to delete:

For implementation, kindly checkout the below video where it's about copying the files, but same logic goes with deleting as well:

Wildcard filters in copy activity of ADF

List of files in copy activity of adf

Hope it helps. Kindly accept the answer if it's helpful. Thankyou