Replace/overwrite using ADF on ADLS

Question

We have ADF pipeline COPY activity to copy the data from Hive to ADLS.
We need replace/overwrite option on ADF copy for file/directory copy to ADLS gen2 .
currently it replaces only if we are inserting/writing with the same filename. we need to replace the old data file/folder with the new data file/folder irrespective of the filename.

Answer 1

Hello @Rama Jaddu and welcome to Microsoft Q&A.

If I understand correctly, you want to replace sink folder, and files, even if it has different name.

Suppose sink has contents:

container  
container/folderX/  
container/folderX/fileX1  
container/folderX/fileX2  
container/folderZ/  
container/folderZ/fileZ1  
container/folderZ/fileZ2  

and you want to write

container/folderNew/  
container/folderNew/Newfile1  
container/folderNew/Newfile2  

How would I know which branch to replace? Should folderX or folderZ be replaced? This is unclear.

You can use the Delete activity to remove a folder and all its files.