Synapse AutoResolveIntegrationRuntime connection failure pipeline

Question

Synapse AutoResolveIntegrationRuntime connection failure pipeline

Roeland Bakker 5

Hi,

I am trying to do REST API calls to a public API using the AutoResolveIntegrationRuntime in Azure Synapse.

If I test the connection of the REST Linked Service, it takes 2 minutes, but after a while it shows 'Connection Succesful' Source Dataset REST

However, when I define the REST dataset as source dataset in my Copy data activity and try to preview the data I receive the following error:

Error code 23360

Details

Fail to read from REST resource.

An error occurred while sending the request.

Unable to connect to the remote server

A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 185.134.251.31:443

User's image

When I do REST API calls to the source API via Postman I receive status 200 OK and I can see the data so the API itself works fine.

When I run the pipeline in debug mode I receive the following error:

{     
"errorCode": "2200",
"message": "Failure happened on 'Source' side. ErrorCode=RestResourceReadFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Fail to read from REST resource.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.Http.HttpRequestException,Message=An error occurred while sending the request.,Source=mscorlib,''Type=System.Net.WebException,Message=Unable to connect to the remote server,Source=System,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond xxx.xxx.xxx.xx:443,Source=System,'",
"failureType": "UserError",     
"target": "cp_xxxxxx_bulk",     
"details": [] 
}

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-06-09T06:07:22.5733333+00:00

@Roeland Bakker Welcome to Microsoft Q&A forum and thanks for reaching out here.

From the error message, it is clear that there is a connection issue which is why the debug run or preview are failing. Since you have mentioned that it works with POSTMAN and failes only when tested using Synapse pipeline (Azure Integration Runtime).

I suspect there could be networking issue which could be the reason your Azure IR is unable to establish connection. Are there any firewall restrictions from your REST service? If there are any firewall restrictions from your REST service, then please try to create a custom Azure IR (specific to a region) and try to whitelist that Azure IR region IP address rage to be able to establish connection to your REST sorce.

Another thing you could try is us a Self hosted integration runtime and enable REST source firewall access to SHIR IP address to establish successful connection.

In case if you are sure that there are no firewall restrictions from your source, then could you please confirm what is the IR being used during the failures, what athenticationType being used for linked service connection?

Thanks
Yanis MOULA 0 Reputation points

2023-12-20T14:46:36.43+00:00

Hello,

Has anyone found a solution? I have exactly the same problem as @Roeland Bakker . I use a managed Vnet

Thanks

1 answer

Your answer

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-06-09T06:07:22.5733333+00:00

@Roeland Bakker Welcome to Microsoft Q&A forum and thanks for reaching out here.

From the error message, it is clear that there is a connection issue which is why the debug run or preview are failing. Since you have mentioned that it works with POSTMAN and failes only when tested using Synapse pipeline (Azure Integration Runtime).

I suspect there could be networking issue which could be the reason your Azure IR is unable to establish connection. Are there any firewall restrictions from your REST service? If there are any firewall restrictions from your REST service, then please try to create a custom Azure IR (specific to a region) and try to whitelist that Azure IR region IP address rage to be able to establish connection to your REST sorce.

Another thing you could try is us a Self hosted integration runtime and enable REST source firewall access to SHIR IP address to establish successful connection.

In case if you are sure that there are no firewall restrictions from your source, then could you please confirm what is the IR being used during the failures, what athenticationType being used for linked service connection?

Thanks
Yanis MOULA 0 Reputation points

2023-12-20T14:46:36.43+00:00

Hello,

Has anyone found a solution? I have exactly the same problem as @Roeland Bakker . I use a managed Vnet

Thanks

Answer 1

Roeland Bakker 5

Hi @Yanis MOULA

In my case it turned out that the REST API host cyper suites were not up to date. After the API provider updated the cypher suites of their host, connection was established successfully.

Hope this fixes the problem for you as well.

Regards

Share via

Synapse AutoResolveIntegrationRuntime connection failure pipeline

1 answer

Your answer