Unexpected Error while the ODBC Connector is trying to execute TDV (Tibco Data Virtualization) command via ADF Self Hosted Integration RunTime

Question

Unexpected Error while the ODBC Connector is trying to execute TDV (Tibco Data Virtualization) command via ADF Self Hosted Integration RunTime

Soumen Das 10

Hi,

This is an weird issue I am getting while a look up activity is throwing the below error even when the work is done at the end.


Copy failed with error: 'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Odbc Operation Failed.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,StackTrace=   at Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector.OdbcDataReader.ExceptionHandler[T](Func`1 func)
   at Microsoft.DataTransfer.ClientLibrary.RelationalDataReader.EstimateRowRawSize()
   at Microsoft.DataTransfer.ClientLibrary.RelationalDataReader.get_EstimatedRowSize()
   at Microsoft.DataTransfer.ClientLibrary.StreamSerializationBase.<InternalSerialize>d__10.MoveNext()
   at Microsoft.DataTransfer.ClientLibrary.SerializerBase.<Serialize>d__108.MoveNext()
   at Microsoft.DataTransfer.ClientLibrary.TransferStream.ReadInternal(Byte[] buffer, Int32 offset, Int32 count)
   at Microsoft.DataTransfer.ClientLibrary.TransferStream.Read(Byte[] buffer, Int32 offset, Int32 count)
   at System.IO.StreamReader.ReadBuffer()
   at System.IO.StreamReader.ReadToEnd()
   at Microsoft.DataTransfer.TransferTask.ExecuteQueryAsyncTask.QueryDataToReport()
   at Microsoft.DataTransfer.TransferTask.ExecuteQueryAsyncTask.QueryDataToInternalBlob()
   at Microsoft.DataTransfer.TransferTask.ExecuteQueryAsyncTask.DoCopy()
   at Microsoft.DataTransfer.TransferTask.CopyTaskBase.Execute(),''Type=System.Data.Odbc.OdbcException,Message=ERROR [] An internal error has occurred.
Unable to commit connection for data source "/shared/00_DataFederation/PolarisCommonModelsSQLPaaS/00_DataSource/dsGCDO/cdosqldb_polaris".  SQL State = null  SQL Error Code = 0  [data-2911010]
Cause: The connection is broken and recovery is not possible. The connection is marked by the client driver as unrecoverable. No attempt was made to restore the connection. [Log ID: e0b70800-29f2-41a2-9faa-9b8dadc1a14b] ,Source=TIBCO(R) Data Virtualization 8.6,StackTrace=   at System.Data.Odbc.OdbcConnection.HandleError(OdbcHandle hrHandle, RetCode retcode)
   at System.Data.Odbc.OdbcDataReader.Read()
   at Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector.OdbcDataReader.ExceptionHandler[T](Func`1 func),'

ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator

2023-07-17T03:22:38.0533333+00:00

Hi Soumen Das, Thank you for sharing your resolution details. Kindly consider marking it as accepted answer. Accepted answers help community as well. Thank you.
PRADEEPCHEEKATLA 90,651 Reputation points Moderator

2023-07-27T08:35:12.68+00:00

@Anonymous - Just checking in to see if the below answer provided by @Andrew Reed helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator

2023-07-17T03:22:38.0533333+00:00

Hi Soumen Das, Thank you for sharing your resolution details. Kindly consider marking it as accepted answer. Accepted answers help community as well. Thank you.
PRADEEPCHEEKATLA 90,651 Reputation points Moderator

2023-07-27T08:35:12.68+00:00

@Anonymous - Just checking in to see if the below answer provided by @Andrew Reed helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

From your provided stack trace, it seems the error occurs while your Azure Data Factory (ADF) Self-hosted Integration Runtime is trying to execute a TIBCO Data Virtualization (TDV) command through the ODBC connector. The issue seems to be due to a broken connection which is unrecoverable as stated by the client driver.

Here are a few suggestions to help troubleshoot and resolve this issue:

Check the Connection: Verify that the ODBC connection to your data source is working correctly. You can test the connection by using another tool, such as SQL Server Management Studio, or a simple ODBC test.

ODBC Driver: Check that you are using the correct and latest ODBC driver for your data source. You may want to update or reinstall the ODBC driver.

Retry Mechanism: Implement a retry mechanism. Sometimes, network glitches can cause such issues, and a retry mechanism can help overcome them.

Resource Issue: Check if there is a resource issue on your database server or the server where the integration runtime is installed. Sometimes, out of memory or high CPU usage can cause such issues.

TIBCO Data Virtualization Issues: If the TDV server is throwing an error, there may be a configuration issue or some other problem on that side. It might be helpful to check the TDV server logs to get more information about the error. Consult with your TDV administrator or reach out to TIBCO support for further assistance.

Update Azure Data Factory: Ensure that your Azure Data Factory and Self-hosted Integration Runtime are updated to the latest version.

Contact Microsoft Support: If you've tried all of the above and you're still having trouble, you may want to contact Microsoft Support. They can provide more specific assistance based on your situation.

Soumen Das 10 Reputation points

2023-07-08T02:10:14.9733333+00:00

Thanks for sharing the troubleshooting steps. It has been resolved after identifying the root cause was "no independent transaction" was initiated at TDV end while calling DB queries.
ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator

2023-07-12T15:26:46.02+00:00

Hi Soumen Das, Thank you for sharing your resolution details. Kindly consider marking it as accepted answer. Accepted answers help community as well. Thank you.

Share via

Unexpected Error while the ODBC Connector is trying to execute TDV (Tibco Data Virtualization) command via ADF Self Hosted Integration RunTime

1 answer

Your answer