Web activity is randomly timing out due to SSL/TLS connection in ADF where its working fine with postman.

Ashish Brahmbhatt 0 Reputation points
2024-01-10T02:59:32.4833333+00:00

Hi there,

While running ADF pipeline it fails randomly with following error:

'ClientSideException : SecureChannelFailure'. More details: Exception message: 'NA - Unknown [ClientSideException] An error occurred while sending the request.'. Request didn't reach the server from the client. This could happen because of an underlying issue such as network connectivity, a DNS failure, a server certificate validation or a timeout. Exception message: 'The request was aborted: Could not create SSL/TLS secure channel.'.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,640 questions
{count} votes

1 answer

Sort by: Most helpful
  1. phemanth 15,765 Reputation points Microsoft External Staff Moderator
    2024-01-10T09:38:26.8233333+00:00

    @Ashish Brahmbhatt

    Thanks for reaching MS Q&A

    The error you’re encountering, ‘ClientSideException : SecureChannelFailure’, typically indicates an issue with the SSL/TLS configuration or network connectivity. Here are some steps you can take to troubleshoot this issue:

    Check the endpoint URL: Ensure that the endpoint URL is correct and accessible from the environment where your Azure Data Factory (ADF) pipeline is running.
    REST endpoints that the web activity invokes must return a response of type JSON. The activity will timeout at 1 minute with an error if it does not receive a response from the endpoint.
    Since in your case it takes more than 1 minute you are seeing error.
    Could you please check if you can make use of HTTP connector for your case?
    Try creating dataset which is HTTP connector type and then use that dataset in lookup activity.

    Check DNS resolution: Make sure the DNS resolution is working correctly in your environment. You can use the lookup command to test the DNS resolution.

    Error Handling in ADF: Azure Data Factory allows conditional logic and enables the user to take a different path based upon outcomes of a previous activity. You can define different paths for success, failure, completion, and skip scenarios. This can help in handling such errors in your ETL/ELT logic.

    geographic area: try choosing different geographic location from current geographic. location to another.

    Hope this helps. Do let us know if you any further queries.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.