How to configure the ADF pipe line to encrypt and decrpt the data at storage account?

Question

Hi Team,

working on the ADF Pipe line how to encrypt the Data in CSV and following the article https:/_/learn.microsoft.com/en-us/azure/data-factory/enable-customer-managed-key but not encrypting the data of the csv .

if any one know how to do let us know,

thanks in advance

Answer 1

Hi @Sri, Srinivas ,

Sorry for the delay in response. I have double checked with internal team about Encrypt Azure Data Factory with customer-managed keys feature and confirmed that this feature is to encrypt the data factory environment i.e., to encrypt data that datafactory storing in the system.

Unfortunately there is no out of box feature in Azure Data factory to perform encryption/decryption of files. Below are couple of feature request suggestions submitted by other Azure users. I would recommend you to please comment and/or up-vote the below user voice items to increase the priority of feature implementation.

https://feedback.azure.com/forums/270578-data-factory/suggestions/40410025-ability-to-decrypt-and-encrypt-the-incoming-and-ou

https://feedback.azure.com/forums/270578-data-factory/suggestions/41023156-add-support-for-gpg-file-decryption

In order to transform/process data in a way that isn't supported by Data Factory, you can create a Custom logic with your own data movement or transformation logic and use the Custom activity in a pipeline. Or another option you could try out is Azure Function Activity.

Additional info :
Here are few related helpful resources:

• https://stackoverflow.com/questions/59684353/azure-pgp-gpg-decryption-of-files
• https://github.com/lfalck/AzureFunctionsPGPDecrypt
• https://learn.microsoft.com/azure/storage/blobs/storage-encrypt-decrypt-blobs-key-vault
• https://medium.com/[@](/users/na/?userId=d88804b8-7ffe-0003-0000-000000000000).dubey21/azure-data-factory-azure-functions-as-pipeline-activity-part1-cab42f0997c5

Hope this info helps.

Thank you

----------

Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.