Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,884 questions
Error happened when loading data into SQL Data Warehouse. Operation: 'GetTargetTableSchemaTable'
shilpa.vadgama@accenture.com
6
Reputation points
I am trying to copy SQL database to SQL Dedicated Pool (Synapse) using Azure Data Factory pipeline and few copy activities are failing with below error:
`ErrorCode=PolybaseOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Error happened when loading data into SQL Data Warehouse. Operation: 'GetTargetTableSchemaTable'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Data.SqlClient.SqlException,Message=Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.,Source=.Net SqlClient Data Provider,SqlErrorNumber=-2,Class=11,ErrorCode=`
Any pointers?
{count} votes
-
BhargavaGunnam-MSFT 10,651 Reputation points Microsoft Employee2022-09-07T22:31:03.363+00:00 Hello @shilpa.vadgama@accenture.com ,
Welcome to the MS Q&A platform.
Please correct me if my understanding is incorrect. You are using copy activity in the pipeline to copy on-prem SQL database to Synapse Dedicated SQL pool to load the data and you are getting the error "The timeout period elapsed prior to completion of the operation or the server is not responding"
Can you please let me know your copy method here? did you test your synapse dedicated linked server connection? also, can you please check the mapping tab and see if you were able to see the correct mapping?
I am copying SQL DB from Azure portal to Dedicated SQL Pool and both are in different subscriptions. I am using Polybase method. Linked connection have been tested. There are nearly 1000 tables which needs to be copy over the pipeline so I am using "Ingest" approach to create the pipeline. Most of the tables have been copied out except few which are failing with the above error.
Hello @shilpa.vadgama@accenture.com ,
Thanks for the reply.
Since you are not using the blob storage directly to copy the data using polybase, are you using the staging account to load data into Azure Synapse Analytics?
Hello @shilpa.vadgama@accenture.com ,
I am just checking in to see if you have any updates here.
And could you please let me know how big these tables are (that are failing) compared to the other tables?
As per the error message, the query execution is getting timed out. Did you get a chance to capture any extended events or profiler traces at the SQL end when you are running the pipeline?
Sign in to comment