Voltage Encryption on-Prem cloud/ VM NFS files -ADF as ETL

Question

Voltage Encryption on-Prem cloud/ VM NFS files -ADF as ETL

Dondapati, Navin 291

Hi Guys,

We use Voltage as encryption for on-premise and cloud, wonder does ADF need any special custom activity to read files from VM Storage
which are encrypted via voltage?

Regards,
Navin

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2021-07-22T05:23:05.113+00:00

Hi @Anonymous ,

Thanks for posting your query. Could you please elaborate a bit about your exact use case scenario? First thing if you are trying to read data from .NFS files, then currently .NFS file format is not supported in data factory. For more info please refer to: https://learn.microsoft.com/en-us/azure/data-factory/supported-file-formats-and-compression-codecs and I assume that might be the reason you would want to use custom activity.

Sorry that I'm not familiar with Voltage encryption, hence would like get more understanding of how it works. So does your data files are Voltage encrypted or the complete Azure VM's are Voltage encrypted? Could you please clarify on this ask? And also I would recommend to check with Voltage product folks here : https://www.microfocus.com/en-us/cyberres/contact on what are the requirements/prerequisites for encryption/decryption.

Thank you
Dondapati, Navin 291 Reputation points

2021-07-22T14:13:07.507+00:00
Hi Kranti,

We extract data from multiple sources and store on NFS drive of our DC

We do have express route connection

We know that ADLS2 have server side encryption

And uses TLS 1.2 while moving data

Our Security team suggest to encrypt existing files using third party tools which are on-premise , But we are not sure if we encrypt the file locally using third party tool and move to ADLS2 via ADF; can the files be in readable format or does we need to decrypt the files.

Else is there any better approach for it?

Regards,
Navin

Accepted answer

0 additional answers

Your answer

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2021-07-22T05:23:05.113+00:00

Hi @Anonymous ,

Thanks for posting your query. Could you please elaborate a bit about your exact use case scenario? First thing if you are trying to read data from .NFS files, then currently .NFS file format is not supported in data factory. For more info please refer to: https://learn.microsoft.com/en-us/azure/data-factory/supported-file-formats-and-compression-codecs and I assume that might be the reason you would want to use custom activity.

Sorry that I'm not familiar with Voltage encryption, hence would like get more understanding of how it works. So does your data files are Voltage encrypted or the complete Azure VM's are Voltage encrypted? Could you please clarify on this ask? And also I would recommend to check with Voltage product folks here : https://www.microfocus.com/en-us/cyberres/contact on what are the requirements/prerequisites for encryption/decryption.

Thank you
Dondapati, Navin 291 Reputation points

2021-07-22T14:13:07.507+00:00

Hi Kranti,

We extract data from multiple sources and store on NFS drive of our DC

We do have express route connection

We know that ADLS2 have server side encryption

And uses TLS 1.2 while moving data

Our Security team suggest to encrypt existing files using third party tools which are on-premise , But we are not sure if we encrypt the file locally using third party tool and move to ADLS2 via ADF; can the files be in readable format or does we need to decrypt the files.

Else is there any better approach for it?

Regards,
Navin

Answer 1

Hi @Anonymous ,

Thanks for your response and additional clarification.

If you would want to encrypt the files before moving it to ADLS Gen2 using a third party tool then files will be encrypted and won't be in readable format. Hence you will have to decrypt the files either while writing to ADLS gen2 or after moving them as is to ADLS Gen2.

The concern here is that there is no out of box feature in ADF which has an ability to decrypt and encrypt the incoming and outgoing files. Hence you will have to use a Custom activity and write your own logic for decryption before copying/moving the files to destination. (Here is a related feedback in user voice forum - Ability to decrypt and encrypt the incoming and outgoing files in DataFactory)

Second option is after encrypting the files in source location, you can use a binary dataset in ADF and copy/move the file as-is to destination. Then again have another process which uses your third party tool to decrypt those files.

Hope this info helps. Do let us know if you have further query.

----------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2021-07-26T23:24:45.077+00:00

Hi @Anonymous ,

Just checking in to see if the above information was helpful. If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Share via

Voltage Encryption on-Prem cloud/ VM NFS files -ADF as ETL

0 additional answers

Your answer