Zip on prem files before copy to Azure blob

Dave 1

the main thing I want to do is in the title, even better, would be the ability to query a db (oracle, SQL Server) using ADF and self-hosted integration runtime services, zip the output, copy to blob storage. Thanks

HarithaMaddi-MSFT 10,136 Reputation points

2020-09-24T14:59:54.76+00:00

Hi anonymous user-0197,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

Copy activity can be used to connect to oracle/SQL DB with SHIR. While copying the file in sink, there is an option to compress as shown below. Please suggest if this option does not meet the requirement and we will be glad to assist further.
Dave 1 Reputation point

2020-09-24T16:05:17.887+00:00

hmm, I've tried to test to see if i start with an uncompressed file on prem and getting errors still. Is the functionality supposed to take a .csv or whatever type of uncompressed file and compress, copy to blob and then uncompress or will it show up in the blob with the .zip? Also, I'm getting that you have to set your dataset as binary for the destination or does it need to be binary on source and destination?

1 answer

HarithaMaddi-MSFT 10,136 Reputation points

2020-09-25T15:48:37.497+00:00

Hi anonymous user-0197,

Thanks for posting the query. Please find below GIF and snap that shows the zipping of files from source into blob into a single zip file. If multiple files needs to be generated, we can use foreach and with variables in copy activity to do the same. Delimited text format supports any file extension that is delimited with configuration details (row and column delimiters) as specified in the dataset. Yes, binary can be used if file content need not be read by ADF and to copy various extensions of files and it shows up in blob as a .zip as shown below. If binary dataset is selected as source, destination also has to be binary.

Hope this helps! Please let us know for specific requirement and we will be glad to assist further.
Please sign in to rate this answer.
HarithaMaddi-MSFT 10,136 Reputation points

2020-09-28T12:07:37.733+00:00

Hi anonymous user-0197,

We have not received a response from you. Please let us know if above answer is helpful. Otherwise, let us know and we will continue to engage with you on the issue.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

HarithaMaddi-MSFT 10,136 Reputation points

2020-09-29T09:05:17.707+00:00

Hi anonymous user-0197,

We still have not heard back from you. Following up to check if above answer is helpful. Otherwise, let us know and we will continue to engage with you on the question.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members
Sign in to comment

Share via

Zip on prem files before copy to Azure blob

1 answer