Unexpected Error while the ODBC Connector is trying to execute TDV (Tibco Data Virtualization) command via ADF Self Hosted Integration RunTime

Soumen Das 10 Reputation points
2023-07-07T00:29:47.9933333+00:00
Hi,

This is an weird issue I am getting while a look up activity is throwing the below error even when the work is done at the end.


Copy failed with error: 'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Odbc Operation Failed.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,StackTrace=   at Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector.OdbcDataReader.ExceptionHandler[T](Func`1 func)
   at Microsoft.DataTransfer.ClientLibrary.RelationalDataReader.EstimateRowRawSize()
   at Microsoft.DataTransfer.ClientLibrary.RelationalDataReader.get_EstimatedRowSize()
   at Microsoft.DataTransfer.ClientLibrary.StreamSerializationBase.<InternalSerialize>d__10.MoveNext()
   at Microsoft.DataTransfer.ClientLibrary.SerializerBase.<Serialize>d__108.MoveNext()
   at Microsoft.DataTransfer.ClientLibrary.TransferStream.ReadInternal(Byte[] buffer, Int32 offset, Int32 count)
   at Microsoft.DataTransfer.ClientLibrary.TransferStream.Read(Byte[] buffer, Int32 offset, Int32 count)
   at System.IO.StreamReader.ReadBuffer()
   at System.IO.StreamReader.ReadToEnd()
   at Microsoft.DataTransfer.TransferTask.ExecuteQueryAsyncTask.QueryDataToReport()
   at Microsoft.DataTransfer.TransferTask.ExecuteQueryAsyncTask.QueryDataToInternalBlob()
   at Microsoft.DataTransfer.TransferTask.ExecuteQueryAsyncTask.DoCopy()
   at Microsoft.DataTransfer.TransferTask.CopyTaskBase.Execute(),''Type=System.Data.Odbc.OdbcException,Message=ERROR [] An internal error has occurred.
Unable to commit connection for data source "/shared/00_DataFederation/PolarisCommonModelsSQLPaaS/00_DataSource/dsGCDO/cdosqldb_polaris".  SQL State = null  SQL Error Code = 0  [data-2911010]
Cause: The connection is broken and recovery is not possible. The connection is marked by the client driver as unrecoverable. No attempt was made to restore the connection. [Log ID: e0b70800-29f2-41a2-9faa-9b8dadc1a14b] ,Source=TIBCO(R) Data Virtualization 8.6,StackTrace=   at System.Data.Odbc.OdbcConnection.HandleError(OdbcHandle hrHandle, RetCode retcode)
   at System.Data.Odbc.OdbcDataReader.Read()
   at Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector.OdbcDataReader.ExceptionHandler[T](Func`1 func),'
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,643 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Andrew Reed 5 Reputation points
    2023-07-07T00:33:43.1266667+00:00

    From your provided stack trace, it seems the error occurs while your Azure Data Factory (ADF) Self-hosted Integration Runtime is trying to execute a TIBCO Data Virtualization (TDV) command through the ODBC connector. The issue seems to be due to a broken connection which is unrecoverable as stated by the client driver.

    Here are a few suggestions to help troubleshoot and resolve this issue:

    Check the Connection: Verify that the ODBC connection to your data source is working correctly. You can test the connection by using another tool, such as SQL Server Management Studio, or a simple ODBC test.

    ODBC Driver: Check that you are using the correct and latest ODBC driver for your data source. You may want to update or reinstall the ODBC driver.

    Retry Mechanism: Implement a retry mechanism. Sometimes, network glitches can cause such issues, and a retry mechanism can help overcome them.

    Resource Issue: Check if there is a resource issue on your database server or the server where the integration runtime is installed. Sometimes, out of memory or high CPU usage can cause such issues.

    TIBCO Data Virtualization Issues: If the TDV server is throwing an error, there may be a configuration issue or some other problem on that side. It might be helpful to check the TDV server logs to get more information about the error. Consult with your TDV administrator or reach out to TIBCO support for further assistance.

    Update Azure Data Factory: Ensure that your Azure Data Factory and Self-hosted Integration Runtime are updated to the latest version.

    Contact Microsoft Support: If you've tried all of the above and you're still having trouble, you may want to contact Microsoft Support. They can provide more specific assistance based on your situation.

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.