Azure Data Factory SFTP Connector Error

Question

Azure Data Factory SFTP Connector Error

dvc 1

I have been attempting to use the ADF SFTP connector to copy csv files from an external source. I can establish a connection successfully and the copy activity in ADF allows a preview of the records in the source files. However, when trying to copy the files to a blob storage sink, I get the following error:

"errorCode": "2200",
"message": "ErrorCode=UserErrorFailedToConnectToSftpServer,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to connect to Sftp server 'sftp.****'.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=Renci.SshNet.Common.SshConnectionException,Message=Server response does not contain SSH protocol identification.,Source=Renci.SshNet,'",
"failureType": "UserError",
"target": "Policy_Quote_Copy",
"details": []

I have tried using both basic and SSH public key authentication without success. Our external provider has added the public IP Addresses for IR in our region (North Europe) to their allowed list. We have also tried different settings for maximum allowed connections and checked if there is throttling on their side.

For reference, an example of a failed pipeline run id is: f3b6061b-2bf9-46b7-9229-2fa5ede209f3 and an associated failed run activity id: 9e94a1b0-e954-4a43-b8ae-0ac4d98eaa5f

Thank you for any help or advice you are able to provide.

dvc

MartinJaffer-MSFT 26,236 Reputation points

2020-08-10T17:18:54.07+00:00

Hello and thank you for your question @dvc .
Do you get this error only when SFTP is source and blob is sink, or do you get it for any sink type?

Thanks, Martin
dvc 1 Reputation point

2020-08-12T07:38:33.81+00:00

Thank you, I am seeing an identical error when I use other sink types (e.g. file system on VM).

Many thanks,

dvc

2 answers

Your answer

MartinJaffer-MSFT 26,236 Reputation points

2020-08-10T17:18:54.07+00:00

Hello and thank you for your question @dvc .
Do you get this error only when SFTP is source and blob is sink, or do you get it for any sink type?

Thanks, Martin
dvc 1 Reputation point

2020-08-12T07:38:33.81+00:00

Thank you, I am seeing an identical error when I use other sink types (e.g. file system on VM).

Many thanks,

dvc

Answer 1

HimanshuSinha-msft 19,491 Microsoft Employee Moderator

Hello @dvc ,

Since you are using the self hosted runtime ( SHIR) , you will have to white list the IP of the SHIR on the SFTP side . Can you please try that and let us know how it goes ?

Thanks Himanshu
Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

dvc 1 Reputation point

2020-08-25T12:02:37.75+00:00

Hello,

Yes, we whitelisted the IP Addresses of the SHIR from the beginning. As you can see from my original question, there is no problem in establishing a connection to the external SFTP site and reading file content. However, the copy operation fails when we attempt to copy a file. We have tried using both basic authentication and SSH public key but still receive the same error: "Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=Renci.SshNet.Common.SshConnectionException,Message=Server response does not contain SSH protocol identification"

Thank you,

dvc
HimanshuSinha-msft 19,491 Reputation points Microsoft Employee Moderator

2020-08-25T19:42:52.04+00:00

Hello @dvc ,

Sorry to know that the issue is still not resolved .

For a deeper investigation and immediate assistance on this issue, if you have a support plan you may file a support ticket, else could you please send an email to AzCommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Thread URL:https://learn.microsoft.com/en-us/answers/questions/63145/index.htm [Azure Data Factory SFTP Connector Error]
Subscription ID:
Subject:Attention Himanshu

Please let me know once you have done the same

Thanks
Himanshu
dvc 1 Reputation point

2020-08-26T15:43:49.95+00:00

Hello Himanshu,

Thank you very much for your help with my question. I have sent, as requested, an email to AzCommunity@microsoft.com.

Many thanks,

Donald
HimanshuSinha-msft 19,491 Reputation points Microsoft Employee Moderator

2020-09-02T23:38:42.567+00:00

Hello @dvc ,

My sincere apoloziges for not repling sooner , we have not recieced the email . Can you please resend the email again please ?

Thanks
Himanshu
PRADEEPCHEEKATLA 90,646 Reputation points Moderator

2020-09-04T11:30:46.65+00:00

Hello @dvc ,
Thank you for reaching out.
We have enabled for one-time free technical support.
I hope you have received one on one support to work towards a resolution on this matter.
Once the issue is sorted out with the support, please do share the resolution, which might be beneficial to other community members reading this issue.

Take care & stay safe!
Elve, Jesse [PHSA] 1 Reputation point

2021-08-23T17:03:12.703+00:00

@HimanshuSinha-msft ,

We are having the identical issue in our environment. Would it be possible to share the solution? Alternatively, should we reach out through other channels for MS support?

Thank you

Answer 2

Xavier Guerette 1

Hi,

Was this problem ever resolved? I am encountering the same error in Synapse Pipelines.

Could you please let me know how to resolve it.

Thank you.

Sincerely,

Xavier

Share via

Azure Data Factory SFTP Connector Error

2 answers

Your answer