Getting this error - "at Source 'source1': com.jcraft.jsch.JSchException: SSH_MSG_DISCONNECT: 11" when previewing data on azure data factory dataflow

Question

I have a dataset that is a csv file existing on azure sftp. I am able to connect to sftp from linked service and able to preview data on the dataset.

I have a dataflow where I want to select a few columns from this csv and copy them onto another csv.

When i add the dataset on the source of the dataflow and try to preview the data I get the below error

"at Source 'source1': com.jcraft.jsch.JSchException: SSH_MSG_DISCONNECT: 11"

I have turned the debug mode on before I previewed the data

Answer 1

Hi @Beebi Thasleem M

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

The error message "com.jcraft.jsch.JSchException: SSH_MSG_DISCONNECT: 11" typically indicates that there is an issue with the SSH connection to the SFTP server.

Here are some possible causes and troubleshooting steps that might help you in resolving the issue:

Network Connectivity - Transient network issues between the Azure Integration Runtime (which executes your data flow) and your SFTP server are a common reason. Verify network connectivity between the ADF Integration Runtime and the SFTP server. If using a self-hosted IR, ensure the machine has proper network configuration. If using Azure IR, ensure outbound connections to your SFTP server are allowed.

SFTP Server Timeouts/Limits - Many SFTP servers have idle timeouts or limits on how long a single connection can last. If the data flow preview takes too long (especially with large files), the server might terminate the connection.

Firewall/Network Security - Firewalls or network rules could be blocking the connection during the data transfer phase.

Server Configuration - The SFTP server might have restrictions or configurations that are causing the disconnection.

SSH Key Format - If you are using a private key for authentication, ensure that it is in the correct format. The PKCS#8 format is not supported; you may need to convert it to the traditional SSH key format.

I hope this information helps. Please do let us know if you have any further queries.

Please do consider to “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

Thank you.

Answer 2

can you confirm the integration runtime associated with the SFTP?

In case if it is SHIR and not Azure IR, then it wont be supported in ADF dataflows which might be causing this issue.

In that scenario, you can copy the data from SFTP into Azure blob as a staging layer and then use file in blob as source within dataflow for further transformations