Encrypt the CSV file before transferring to SFTP

Question

Dear Team,

As per our requirement, we need to encrypt the CSV file and transfer it to SFTP using ADF.

I have checked in ADF, but there is no option to encrypt the CSV file.

Can someone please assist on how to encrypt the CSV file using public shared key using ADF?

Thanks,
Divakar

Answer 1

Hey,
Based on my understanding

Unfortunately there is no out of box feature in Azure Data factory to perform encryption/decryption of files. Below are couple of feature request suggestions submitted by other Azure users. I would recommend you to please comment and/or up-vote the below user voice items to increase the priority of feature implementation.

https://feedback.azure.com/forums/270578-data-factory/suggestions/40410025-ability-to-decrypt-and-encrypt-the-incoming-and-ou

https://feedback.azure.com/forums/270578-data-factory/suggestions/41023156-add-support-for-gpg-file-decryption

In order to transform/process data in a way that isn't supported by Data Factory, you can create a Custom logic with your own data movement or transformation logic and use the Custom activity in a pipeline. Or another option you could try out is Azure Function Activity.

Additional info :
Here are few related helpful resources:

• https://stackoverflow.com/questions/59684353/azure-pgp-gpg-decryption-of-files
• https://github.com/lfalck/AzureFunctionsPGPDecrypt
• https://learn.microsoft.com/azure/storage/blobs/storage-encrypt-decrypt-blobs-key-vault
• https://medium.com/[@](/users/na/?userId=d88804b8-7ffe-0003-0000-000000000000).dubey21/azure-data-factory-azure-functions-as-pipeline-activity-part1-cab42f0997c5

Answer 2

I was told that since we are sending it over SFTP, we don't need to encrypt the data. As per my understanding even if we are sending data over SFTP, we should encrypt it.

Answer 3

@Vandana Chaturvedi , We should encrypt the file even if we are sending data over SFTP.

Thanks,