Zipped File in Azure Data factory Pipeline adds extra files

Rachael Cecilia Dsouza 96 Reputation points
2021-04-26T22:46:05.13+00:00

have a Data Factory pipeline (copy activity) that zips an entire folder and adds it to an Archive Folder. The folder Structure in Blob storage Main/Network/data.csv.

The source and sink use binary datasets
source location: wildcard path ->container/Main*
sink location:container/Archive/
compresessiontype ->.zipdeflate
I zip the entire Main folder and copy it to another Archive folder

Archive Folder: Main.zip
When I download this file and unzip it, the Main folder contains
91471-56.png
Is there a way the network file can be avoided in the pipeline? because when I unzip the file, the network folder gets deleted since it has the same file and folder name

Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,544 questions
Accepted answer
  1. Rachael Cecilia Dsouza 96 Reputation points
    2021-04-28T13:36:01.377+00:00

    Hi @KranthiPakala-MSFT

    Thank you for replying,
    I was able to solve this issue by switching to a data lake linked service and avoided the wildcard entry option, it then worked as expected.

    Regards,
    Rachael

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest