ADF copy data issue

Question

ADF copy data issue

Emma Rowley 6

I have ADF pipeline which has a copy data activity connecting to Rest API as the source and Blob Storage as the sink.

For the Rest API the "Test Connection" for Linked Service (REST) is successful, the "Preview data" of Pipeline Source gives me the data as expected. However when I trigger my flow I am getting the following error message:

Error code: 2200

Failure type: User configuration issue

Details:
Failure happened on 'Source' side. ErrorCode=UserErrorFailToReadFromRestResource,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=An error occurred while sending the request.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.Http.HttpRequestException,Message=An error occurred while sending the request.,Source=mscorlib,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond

Any idea about how I can fix this? I don't understand why I can preview the data successfully but the flow fails when triggered.

KranthiPakala-MSFT 46,622 Reputation points Microsoft Employee

2021-10-12T22:48:18.207+00:00

HI @Emma Rowley ,

Welcome to Microsoft Q&A forum and thanks for reaching out.

Could you please confirm if you were able to retrieve the REST API data using other tools like POSTMAN, Curl? The reason I would want to confirm on this is to make sure if the issue is specific to ADF REST connector or the source REST API.

And also please confirm if the issue is consistent or intermittent? Also please do share the failed pipeline runID and activity runID for further analysis on this.

Thank you
KranthiPakala-MSFT 46,622 Reputation points Microsoft Employee

2021-10-15T05:52:35.937+00:00

HI @Emma Rowley ,

We still have not heard back from you. Just wanted to check if you are still facing the issue or need assistance on this? In case If you already found a solution, would you please share it here with the community? Otherwise, please do confirm the details mentioned in my previous response, so that we will continue to engage with you on the issue.

Thank you
GabrieleP 6 Reputation points

2021-10-15T14:36:06.453+00:00

Hello,

I'm facing the same issue.

I have ADF pipeline which has a Copy Data activity connecting to Rest API as the source and Azure SQL Database Managed Instance as the sink.

for the Rest API the "Test Connection" for Linked Service (REST) is successful, the "Preview data" of Pipeline Source gives me the data as expected. However when I trigger my flow I am getting the following error message:

ErrorCode 2200

Failure type User configuration issue

Details

ErrorCode=UserErrorFailToReadFromRestResource,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=An error occurred while sending the request.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.Http.HttpRequestException,Message=An error occurred while sending the request.,Source=mscorlib,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond [IP_Address],Source=System,'

I also tried to call the REST API using a Web activity and it works well (of course, without using the Rest connector).
I don't understand why the flow fails when triggered using Copy Data activity.

Can you help me?
KranthiPakala-MSFT 46,622 Reputation points Microsoft Employee

2021-10-23T00:56:12.587+00:00

Hi GabrieleP-5752,

Thanks for reaching out here. Were you able to test the API in other tools like POSTMAN, Curl? If you are able to preview the data and not able to get data when you trigger run the pipeline, then I would recommend you to please file a support ticket for deeper analysis. This issues looks strange and may need a deeper analysis. In case if you don't have a support plan, please let us know here.
Anonymous

2024-02-22T14:45:56.5766667+00:00

I am getting the same error and I tried all possible ways to make sure the Self-hosted IR is accessible to the public network for the Data Factory to connect with. Please share the troubleshooting steps to fix this error:
Failure happened on 'Source' side. ErrorCode=RestResourceReadFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Fail to read from REST resource.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.Http.HttpRequestException,Message=An error occurred while sending the request.,Source=mscorlib,''Type=System.Net.WebException,Message=The request was aborted: Could not create SSL/TLS secure channel.,Source=System,'

3 answers

Your answer

KranthiPakala-MSFT 46,622 Reputation points Microsoft Employee

2021-10-12T22:48:18.207+00:00

HI @Emma Rowley ,

Welcome to Microsoft Q&A forum and thanks for reaching out.

Could you please confirm if you were able to retrieve the REST API data using other tools like POSTMAN, Curl? The reason I would want to confirm on this is to make sure if the issue is specific to ADF REST connector or the source REST API.

And also please confirm if the issue is consistent or intermittent? Also please do share the failed pipeline runID and activity runID for further analysis on this.

Thank you
KranthiPakala-MSFT 46,622 Reputation points Microsoft Employee

2021-10-15T05:52:35.937+00:00

HI @Emma Rowley ,

We still have not heard back from you. Just wanted to check if you are still facing the issue or need assistance on this? In case If you already found a solution, would you please share it here with the community? Otherwise, please do confirm the details mentioned in my previous response, so that we will continue to engage with you on the issue.

Thank you
GabrieleP 6 Reputation points

2021-10-15T14:36:06.453+00:00

Hello,

I'm facing the same issue.

I have ADF pipeline which has a Copy Data activity connecting to Rest API as the source and Azure SQL Database Managed Instance as the sink.

for the Rest API the "Test Connection" for Linked Service (REST) is successful, the "Preview data" of Pipeline Source gives me the data as expected. However when I trigger my flow I am getting the following error message:

ErrorCode 2200

Failure type User configuration issue

Details

ErrorCode=UserErrorFailToReadFromRestResource,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=An error occurred while sending the request.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.Http.HttpRequestException,Message=An error occurred while sending the request.,Source=mscorlib,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond [IP_Address],Source=System,'

I also tried to call the REST API using a Web activity and it works well (of course, without using the Rest connector).
I don't understand why the flow fails when triggered using Copy Data activity.

Can you help me?
KranthiPakala-MSFT 46,622 Reputation points Microsoft Employee

2021-10-23T00:56:12.587+00:00

Hi GabrieleP-5752,

Thanks for reaching out here. Were you able to test the API in other tools like POSTMAN, Curl? If you are able to preview the data and not able to get data when you trigger run the pipeline, then I would recommend you to please file a support ticket for deeper analysis. This issues looks strange and may need a deeper analysis. In case if you don't have a support plan, please let us know here.
Anonymous

2024-02-22T14:45:56.5766667+00:00

I am getting the same error and I tried all possible ways to make sure the Self-hosted IR is accessible to the public network for the Data Factory to connect with. Please share the troubleshooting steps to fix this error:
Failure happened on 'Source' side. ErrorCode=RestResourceReadFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Fail to read from REST resource.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.Http.HttpRequestException,Message=An error occurred while sending the request.,Source=mscorlib,''Type=System.Net.WebException,Message=The request was aborted: Could not create SSL/TLS secure channel.,Source=System,'

Answer 1

GabrieleP 6

Hi @KranthiPakala-MSFT ,

thanks for your replay.
I have investigated deeper and I realized that it was a firewall issue. Some blocking rules didn't allow to reach out the datasource.
I'm sorry for the question, everything is working well now.

KranthiPakala-MSFT 46,622 Reputation points Microsoft Employee

2021-10-25T18:12:30.987+00:00

Hi @GabrieleP ,

Thanks for your response and glad to know that the issue was resolved. Appreciate much for sharing the root cause details as it would be helpful for others reading this thread. Feel free to accept your own answer.

Thank you

Answer 2

Ram Raju 6

@GabrieleP Can you please share how you resolved this issue? I am currently facing the same issue. Thanks!

Answer 3

Antonio Sagbini 1

I too was having the same issue, and it turned out to be a Firewall issue as mentioned by @GabrieleP

My setup was copying data from a rest API to a SQL on-Prem database going through an Integration Runtime.

Once the networks guys opened the Firewall between my Integration Runtime server and the target API Url, the Data Factory package worked.

Share via

ADF copy data issue

3 answers

Your answer