Azure datafactory Marketing cloud sFTP connection error
We are trying to connect to the sFTP server hosted on Salesforce Marketing cloud. We are using the sFTP connector as a source on an Azure data factory pipeline. Even though we are able to test the connection and browse/preview the source successfully, when trying to execute the copy activity, we are getting the below error:
{ "errorCode": "2200", "message": "ErrorCode=SftpNetworkIssue,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Meet network issue
when connect to Sftp server 'mc871qqp8bp5k4ljq9f4hpppn-g1.ftp.marketingcloudops.com', SocketErrorCode: 'ConnectionReset'.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=System.Net.Sockets.SocketException,Message=An existing connection was forcibly closed by the remote host,Source=System,'", "failureType": "UserError", "target": "Copy data1", "details": [] }
When we approached the Salesforce support team, and they suggested to whitelist the Salesforce IPs on Azure but I'm aware that ADF does not have any option whitelist IPs. The only thing I can think of is whitelisting Azure IR IPs on the sFTP server. To add, we tried connecting to the sFTP server using Filezilla and we were able to connect successfully and download the files from there which tells me that this is not an IP whitelisting problem. Just wanted to check if there is something else we can try.
We have set the max concurrency to 1 and we still got the same error.
Sample pipeline run id : 4adfae63-73fd-453b-9d8d-e3cafbe5d162