Zipped File in Azure Data factory Pipeline adds extra files

asked 2021-04-26T22:46:05.13+00:00
Rachael Cecilia Dsouza 96 Reputation points

have a Data Factory pipeline (copy activity) that zips an entire folder and adds it to an Archive Folder. The folder Structure in Blob storage Main/Network/data.csv.

The source and sink use binary datasets
source location: wildcard path ->container/Main*
sink location:container/Archive/
compresessiontype ->.zipdeflate
I zip the entire Main folder and copy it to another Archive folder

Archive Folder: Main.zip
When I download this file and unzip it, the Main folder contains
91471-56.png
Is there a way the network file can be avoided in the pipeline? because when I unzip the file, the network folder gets deleted since it has the same file and folder name

Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,247 questions
{count} votes

Accepted answer
  1. answered 2021-04-28T13:36:01.377+00:00
    Rachael Cecilia Dsouza 96 Reputation points

    Hi @KranthiPakala-MSFT

    Thank you for replying,
    I was able to solve this issue by switching to a data lake linked service and avoided the wildcard entry option, it then worked as expected.

    Regards,
    Rachael


0 additional answers

Sort by: Most helpful