Failed to execute delete activity with data source 'Sftp' and error 'Meet network issue when connect to Sftp server 'sftp.xx', SocketErrorCode: 'ConnectionReset'.

Siddharth Srinivasan 1 Reputation point
2022-09-12T18:39:02.123+00:00

It says "An existing connection was forcibly closed by the remote host'.
kindly let me know how to rectify this error.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,528 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,149 questions
{count} votes

2 answers

Sort by: Most helpful
  1. ShaktiSingh-MSFT 16,171 Reputation points
    2022-09-13T11:34:14.963+00:00

    Hi @Siddharth Srinivasan ,

    Welcome to Microsoft Q&A platform and thanks for using Azure Services.

    As I understand your issue in SFTP connection, could you please try below options:

    • The issue might be due to Firewall.
      If you are using Azure Integration Runtime, then you could choose to add Azure Integration Runtime IPs into the allow list.
      if you are using Self Hosted Integration Runtime (SHIR) on either source or sink and if the access is restricted to IPs that are whitelisted in the firewall rules of your SFTP, then could you please make sure to whitelist the IP address of the machine that hosts your SHIR.

    Link for Azure IP Ranges and Service Tags

    • The number of Max concurrent connections to your SFTP server could be another reason. Could you please check what is the maximum concurrent connection limit to your sftp server? Based on that please set your sink Max concurrent connection less than the SFTP concurrent connection limit set by SFTP admin.

    240498-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    0 comments No comments

  2. Siddharth Srinivasan 1 Reputation point
    2022-09-13T15:24:44.837+00:00

    This pipeline runs every hour copying files from SFTP to datalake and once the copying completes, the data from the sftp is deleted.
    It has been in use for more than a year but suddenly from the past 2 weeks, randomly we are getting this error.
    I don't think it can be the firewall, as that should cause errors in all the runs, shouldn't it?

    Kindly help me investigate the issue @ShaktiSingh-MSFT


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.