Error happened when loading data into SQL Data Warehouse. Operation: 'GetTargetTableSchemaTable'

shilpa.vadgama@accenture.com 6

I am trying to copy SQL database to SQL Dedicated Pool (Synapse) using Azure Data Factory pipeline and few copy activities are failing with below error:

`ErrorCode=PolybaseOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Error happened when loading data into SQL Data Warehouse. Operation: 'GetTargetTableSchemaTable'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Data.SqlClient.SqlException,Message=Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.,Source=.Net SqlClient Data Provider,SqlErrorNumber=-2,Class=11,ErrorCode=`

Any pointers?

Bhargava-MSFT 31,121 Reputation points Microsoft Employee

2022-09-07T22:31:03.363+00:00

Hello @shilpa.vadgama@accenture.com ,

Welcome to the MS Q&A platform.

Please correct me if my understanding is incorrect. You are using copy activity in the pipeline to copy on-prem SQL database to Synapse Dedicated SQL pool to load the data and you are getting the error "The timeout period elapsed prior to completion of the operation or the server is not responding"

Can you please let me know your copy method here? did you test your synapse dedicated linked server connection? also, can you please check the mapping tab and see if you were able to see the correct mapping?
shilpa.vadgama@accenture.com 6 Reputation points

2022-09-08T00:03:22.203+00:00

I am copying SQL DB from Azure portal to Dedicated SQL Pool and both are in different subscriptions. I am using Polybase method. Linked connection have been tested. There are nearly 1000 tables which needs to be copy over the pipeline so I am using "Ingest" approach to create the pipeline. Most of the tables have been copied out except few which are failing with the above error.
Bhargava-MSFT 31,121 Reputation points Microsoft Employee

2022-09-13T00:21:30.867+00:00

Hello @shilpa.vadgama@accenture.com ,
Thanks for the reply.
Since you are not using the blob storage directly to copy the data using polybase, are you using the staging account to load data into Azure Synapse Analytics?
Bhargava-MSFT 31,121 Reputation points Microsoft Employee

2022-09-15T21:05:48.51+00:00

Hello @shilpa.vadgama@accenture.com ,

I am just checking in to see if you have any updates here.

And could you please let me know how big these tables are (that are failing) compared to the other tables?

As per the error message, the query execution is getting timed out. Did you get a chance to capture any extended events or profiler traces at the SQL end when you are running the pipeline?

Share via

Error happened when loading data into SQL Data Warehouse. Operation: 'GetTargetTableSchemaTable'

Your answer