Azure Data Factory | Sybase database connector | Unable to fetch data

Question

Azure Data Factory | Sybase database connector | Unable to fetch data

Pranjal Jain 0

Pulling Data from Sybase IQ Database hosted on an OnPrem VM using Azure Data factory into Azure Blob.

Copy Activity Details

Source: Sybase database (SHIR Installed on VM - Connection Successful)
Source tab Query: select * from <tablename>
Preview Data option is working
Destination: Azure Blob Storage (csv delimited text)
Error Details: Failure happened on 'Source' side. ErrorCode=UserErrorFailedFileOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The file operation is failed, upload file failed at path: 'BlobPath/tablename.csv'.,Source=Microsoft.DataTransfer.Common,''Type=Microsoft.Data.Mashup.MashupValueException,Message=Sybase SQL Anywhere: Invalid data conversion,Source=Microsoft.MashupEngine,' Workarounds done till now
- Reconfigured/reinstalled Integration Runtime
- Recreated new linked service
Recreated new datasets
SAP SQL Anywhere 16/17 installed on the VM

QuantumCache 20,366 Reputation points Moderator

2024-01-25T20:02:11.2933333+00:00
Hello @pranjal jain Are you able to connect to Sybase IQ Database outside of ADF? Is it successful?

What is the version of Sybase SQL Anywhere installed on the VM?
Is the SHIR of latest version?
The error message shows some **"**Invalid data conversion" If Possible please do provide more context on this issue, so that we could help you as much as possible! To address this, you can try the following:

Check the data types

Check the delimiter

Check the file format

Check the permissions

Let us know if you have any further questions.
QuantumCache 20,366 Reputation points Moderator

2024-02-09T04:47:32.6366667+00:00

Hello @Pranjal Jain Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!
Pranjal Jain 0 Reputation points

2024-02-09T09:24:07.5033333+00:00

@SatishBoddu-MSFT, apologies for the late response. Sybase sql anywhere version - I've checked using both 16 and 17, both give the same error SHIR version- Latest Datatype: This is only happening for decimal datatype columns, Casting it into decimal solves the issue. This is obviously not the fix in case we are calling multiple table using table name and passing through a for each loop. Delimiter: Source is a sql table and destination is a csv file so don't think this is the issue file format: same as above Permissions: Checked
QuantumCache 20,366 Reputation points Moderator

2024-02-12T22:28:20.5133333+00:00

Pranjal Jain Thanks for providing more info on this issue! We may need to investigate this issue in much deeper way, please submit a Technical Support Ticket in this matter.

1 answer

Your answer

QuantumCache 20,366 Reputation points Moderator

2024-01-25T20:02:11.2933333+00:00

Hello @pranjal jain Are you able to connect to Sybase IQ Database outside of ADF? Is it successful?

What is the version of Sybase SQL Anywhere installed on the VM?
Is the SHIR of latest version?
The error message shows some **"**Invalid data conversion" If Possible please do provide more context on this issue, so that we could help you as much as possible! To address this, you can try the following:

Check the data types

Check the delimiter

Check the file format

Check the permissions

Let us know if you have any further questions.
QuantumCache 20,366 Reputation points Moderator

2024-02-09T04:47:32.6366667+00:00

Hello @Pranjal Jain Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!
Pranjal Jain 0 Reputation points

2024-02-09T09:24:07.5033333+00:00

@SatishBoddu-MSFT, apologies for the late response. Sybase sql anywhere version - I've checked using both 16 and 17, both give the same error SHIR version- Latest Datatype: This is only happening for decimal datatype columns, Casting it into decimal solves the issue. This is obviously not the fix in case we are calling multiple table using table name and passing through a for each loop. Delimiter: Source is a sql table and destination is a csv file so don't think this is the issue file format: same as above Permissions: Checked
QuantumCache 20,366 Reputation points Moderator

2024-02-12T22:28:20.5133333+00:00

Pranjal Jain Thanks for providing more info on this issue! We may need to investigate this issue in much deeper way, please submit a Technical Support Ticket in this matter.

Answer 1

What is the version of Sybase SQL Anywhere installed on the VM? Checked on Both SQL Anywhere 16/17
Is the SHIR of latest version? Latest version
Check the data types: This is happening only on decimal datatype columns which can be solved if I use the cast function to convert specificaly into decimal column. This is ot a permanent solution as if I want to import data from multiple table (calling table name within a foreach loop), It will just throw an error.
Check the delimiter: Source is a sql table and destination is a csv file,
Check the file format : Same as above
Check the permissions: Checked for appropriate permissions

Share via

Azure Data Factory | Sybase database connector | Unable to fetch data

1 answer

Your answer