Data Factory Copy - SQL Azure Timeout

Mike McGuinness 26 Reputation points
2022-02-01T18:09:56.543+00:00

I have a Copy Data task in a pipeline that keeps timing out. The task is supposed to copy 399,113 rows from a CSV file to an Azure SQL table. Works fine using SSIS.

The ADF sink fails every time after about 2:12 or 2:13 minutes into the "Writing to sink" step.

I increased the Azure SQL Database DTUs from 20 to 50, but it had zero effect. 170288-adf-copy-timeout.png

Operation on target Import AVS SEC Pricing from CSV failed: ErrorCode=SqlOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=A database operation failed. Please search error to get more details.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Data.SqlClient.SqlException,Message=Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. The statement has been terminated.,Source=.Net SqlClient Data Provider,SqlErrorNumber=-2,Class=11,ErrorCode=-2146232060,State=0,Errors=[{Class=11,Number=-2,State=0,Message=Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.,},{Class=0,Number=3621,State=0,Message=The statement has been terminated.,},],''Type=System.ComponentModel.Win32Exception,Message=The wait operation timed out,Source=,'

Azure SQL Database
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
0 comments No comments
{count} votes

12 answers

Sort by: Most helpful
  1. Michael Burns (Ministry of Health) 1 Reputation point
    2022-06-12T10:30:37.96+00:00

    was having same timeout issue , had the timeout and batch size as empty, found setting them to 100,000 batch + 10.23:55:55 timeout resolved the issue for me.


  2. Venkatesh Srinivasan 86 Reputation points
    2022-06-13T10:16:25.637+00:00

    I have fixed this issue by increasing DB timeout. It worked well for me.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.