Share via

Job failed due to reason: java.lang.Throwable: DataFlow Manager Client.getPayload fail to getPayload request for run: , exception:java.net.SocketTimeoutException: Read timed out

Gużewski, Jacek 95 Reputation points
2023-03-06T08:18:09.2566667+00:00

Hi,
I am running an ADF pipeline with data flow where copying data from ADLS from parquet file to Azure SQL Database and this data flow ended up with error:

"Job failed due to reason: java.lang.Throwable: DataFlowManagerClient.getPayload fail to getPayload request for run:fc0c0efc-f699-4142-b56e-e8df340f979e, exception:java.net.SocketTimeoutException: Read timed out"

This not the only problem in this environment, because I have another simple pipelines, where I copy data form Blob Storage Account to ADLS (from csv to parquet) and when I run this pipeline and it stucks on a copy data component with status "queued".

I can't figure out where is the problem.

Best regards,

Jacek

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee
    2023-03-07T09:11:23.0766667+00:00

    Hi @Gużewski, Jacek ,

    Welcome to Microsoft Q&A platform and thanks for posting your question here.

    I understand your pipeline is failing with the timeout error having this exception: "java.net.SocketTimeoutException" . Please let me know if that is not the case here.

    This could be a transient error, however, it is related to network issues, or a problem with the data source. Kindly recreate the underlying linked service again and see if it helps in resolving the issue.

    If the suggested approach doesn't help, kindly make sure you are using Azure integration runtime , not self hosted and also that it is in online state .

    For more information, kindly check the following document: Optimizing performance of the Azure Integration Runtime

    Hope it helps. Kindly accept the answer and mark it as helpful as accepted answer helps community.

    0 comments