Access (not create) a sftp server on a PRIVATE endpoint via azure data factory linked services?

Question

Hey,

Can we access (not create) a sftp server on a PRIVATE endpoint via azure data factory linked services?

Thanks

Jay

Answer 1

Hi , hope doing well

To answer your query

Azure Data Factory (ADF) does not support connecting to SFTP servers via private endpoints directly. Azure Data Factory supports various types of linked services, including Azure Blob Storage, Azure SQL Database, and more, but SFTP is not a natively supported data store.

To connect to an SFTP server from Azure Data Factory, you typically need to use a custom solution or a third-party integration. Here's a high-level approach you can take:

Set up a Virtual Machine (VM) or Azure Function: You can create an Azure VM or an Azure Function that runs your custom code to connect to the SFTP server.

Configure Network and Security: Ensure that the VM or Azure Function is on the same virtual network as your Azure Data Factory, and set up network security rules to allow communication between them. You can use Azure VNet Peering or a VPN Gateway for secure communication.

Custom Code: Write custom code in the VM or Azure Function to connect to the SFTP server, perform the necessary data transfer operations, and make the data available to Azure Data Factory.

Triggering: You can trigger your custom solution from Azure Data Factory using Azure Logic Apps, Azure Functions, or other integration methods.

MS doc for ref: https://learn.microsoft.com/en-us/azure/data-factory/concepts-linked-services?tabs=data-factory

Please accept answer , if it helps , Thankyou!

Answer 2

Hello @Jatin Bhambhani

Please go through the below articles and do let us know if they are helpful?

Azure Data Factory managed virtual network

Copy and transform data in SFTP server using Azure Data Factory or Azure Synapse Analytics