Zip on prem files before copy to Azure blob

Dave 1 Reputation point
2020-09-24T01:21:02.927+00:00

the main thing I want to do is in the title, even better, would be the ability to query a db (oracle, SQL Server) using ADF and self-hosted integration runtime services, zip the output, copy to blob storage. Thanks

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,132 questions
{count} votes

1 answer

Sort by: Most helpful
  1. HarithaMaddi-MSFT 10,126 Reputation points
    2020-09-25T15:48:37.497+00:00

    Hi anonymous user-0197,

    Thanks for posting the query. Please find below GIF and snap that shows the zipping of files from source into blob into a single zip file. If multiple files needs to be generated, we can use foreach and with variables in copy activity to do the same. Delimited text format supports any file extension that is delimited with configuration details (row and column delimiters) as specified in the dataset. Yes, binary can be used if file content need not be read by ADF and to copy various extensions of files and it shows up in blob as a .zip as shown below. If binary dataset is selected as source, destination also has to be binary.

    28310-zipfilesadf.gif

    Hope this helps! Please let us know for specific requirement and we will be glad to assist further.