Want to decrypt csv files coming from aws s3 bucket using adf in blob using pgp encryption/decryption

Amar Agnihotri 916 Reputation points
2022-03-31T15:10:26.153+00:00

Hi,
I have created an adf pipeline which is copying .csv files from s3 to blob . The files in the s3 are encrypted using PGP encryption. Now since these are copied to blob so now i need to decrypt these files using PGP in adf so that i could use them for analysis purpose.. Can anyone suggest some workflow and useful links to achieve that .

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,488 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,743 questions
0 comments No comments
{count} votes

Accepted answer
  1. Pratik Somaiya 4,201 Reputation points
    2022-04-01T04:21:46.87+00:00

    Hello @Amar Agnihotri

    There's no feature in ADF which can directly decrypt the file or data, but you can achieve this either via a Custom Activity or Databricks Activity

    Please find links related to the same:

    1) https://learn.microsoft.com/en-us/answers/questions/92913/decryption-pgp-file-in-azure-gen2-via-adf.html

    2) https://www.linkedin.com/pulse/pgp-file-decrypt-using-azure-data-factory-richard-kashyap-deka/


0 additional answers

Sort by: Most helpful