Add gpg encrypt/decrypt to datasets in Data Factory on both source and sink

Question

Would it be possible to add a gpg decrypt/encrypt option on the datasets, much like zip compression is today and perhaps allow the keys to be stored and retrieved from keyvault.

Answer 1

Hi @Chapman, Phil ,

Thank you for posting query in Microsoft Q&A Platform.

As per my understanding you are looking ways to encrypt or decrypt data which data factory process. Correct me if my understanding is wrong.

Customer managed keys will help to Encrypt Azure data factory. Click here for detailed documentation and steps to follow for same.

Encrypt Azure Data Factory with customer-managed keys feature is to encrypt the data factory environment i.e., to encrypt data that data factory storing in the system.

If you are looking for storing data in source and sink in encrypted way using ADF, then Unfortunately there is no out of box feature in Azure Data factory to perform encryption/decryption of files.

Below is feedback item added for GCP encryption. I would recommend to please comment and/or up-vote on it to increase the priority of feature implementation.
https://feedback.azure.com/d365community/idea/713599fb-6c26-ec11-b6e6-000d3a4f032c

You can consider creating a Custom logic with your own data movement or transformation logic and use the Custom activity in a pipeline. Or another option you could try out is Azure Function Activity.

Below are few related helpful resources:

• https://stackoverflow.com/questions/59684353/azure-pgp-gpg-decryption-of-files
• https://github.com/lfalck/AzureFunctionsPGPDecrypt
• https://learn.microsoft.com/azure/storage/blobs/storage-encrypt-decrypt-blobs-key-vault
• https://medium.com/[@](/users/na/?userId=d88804b8-7ffe-0003-0000-000000000000).dubey21/azure-data-factory-azure-functions-as-pipeline-activity-part1-cab42f0997c5

Hope this helps. Please let us know if any further queries.

-----------

Please consider hitting Accept Answer. Accepted answers helps community as well.