Failure happened source side in copy activity for vertica source.

Ashutosh Yadav 1

Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Vertica][Support] (50310) Unrecognized ICU conversion error.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Vertica][Support] (50310) Unrecognized ICU conversion error.,Source=vertica_9.2_odbc_3.5_64.dll,'

Ashutosh Yadav 1 Reputation point

2021-07-08T06:15:28.64+00:00

please help in getting resolution
ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee

2021-07-09T10:25:59.073+00:00
Hi @Ashutosh Yadav ,

Thank you for posting query in Microsoft Q&A Platform.

Could you please help on below clarifications to understand issue better and help on resolution.

In Which activity you are facing above error?

Could you please share configuration details of activity which is failing?

It would be great if you can give little insights about your logic and share error screenshots along with above requested details.

Thank you.
ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee

2021-07-13T04:54:37.347+00:00

Hi @Ashutosh Yadav ,

Did you get chance to share details on above requested clarifications?
Ashutosh Yadav 1 Reputation point

2021-07-13T05:19:09.09+00:00

facing this error in copy activity when copying data from vertica source to adls.
Its working fine for other tables but for this getting above mentioned error.

Also for this table I successfully able to copy data for 2019 year but for other years same error.. I am assuming i am getting this error because of data issue may be some column have unwanted character..
ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee

2021-07-16T05:55:07.617+00:00

Hi @Ashutosh Yadav ,

Thank you for sharing details.

Yes it looks like data issue in that table as its working fine data for 2019. It would be great if you can share sample data which actually causing issue. So that we can try to repro scenario to help better on resolution.

Thank you.
ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee

2021-07-20T01:16:06.137+00:00

Hi @Ashutosh Yadav ,

Following up to check did you get chance to share sample data which actually causing issue?
ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee

2021-07-22T05:49:38.91+00:00

Hi @Ashutosh Yadav ,

Just checking did you get chance to share sample data which actually causing issue?
Ashutosh Yadav 1 Reputation point

2021-07-23T06:07:34.287+00:00

Hi @ShaikMaheer-MSFT I am not able to figure out what data exactly causing this issue as table has million of record so not possible to get exact issue records which causing the issue
ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee

2021-07-26T05:24:57.4+00:00

Hi @Ashutosh Yadav ,

Thank you for posting query in Microsoft Q&A Platform and thank you for sharing details on clarifications.

Looks like related to data issue in your table. Kindly use fault tolerance settings to skip incompatible rows and log them to some storage and have review on that incompatible rows internally to take a call.

Please check below link to know more about "Fault tolerance of copy activity in Azure Data Factory"
https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-fault-tolerance
Ashutosh Yadav 1 Reputation point

2021-07-26T12:23:01.677+00:00

@ShaikMaheer-MSFT I have tried above mentioned steps in the log getting below details which is of no use

Timestamp,Level,OperationName,OperationItem,Message
2021-07-26 12:17:17.1462177,Info,FileWrite,"ZBB_2021_10","Start to write file."

error:
Details
Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Vertica][Support] (50310) Unrecognized ICU conversion error.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Vertica][Support] (50310) Unrecognized ICU conversion error.,Source=vertica_9.2_odbc_3.5_64.dll,'
·
Ashutosh Yadav 1 Reputation point

2021-07-26T14:35:30.527+00:00

seems some special characters in source ..
but why this is causing the issue not sure if you can suggest something on this.
ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee

2021-07-27T06:29:11.48+00:00

Hi @Ashutosh Yadav ,

It seems that for some particular string(s) that the error happening. Try to use different encoding options available in your source dataset and see if that resolves your problem. Thank you.
ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee

2021-07-30T05:37:12.537+00:00

Hi @Ashutosh Yadav ,

Just checking did you get chance to work with different encoding options available in dataset and see if that helps?
Yajaira Mendoza 1 Reputation point

2021-11-16T17:01:41.93+00:00

Al parecer es un tipo de dato, el problema, debes castear el origen de acuerdo al destino que lo va a recibir; hay dos opciones; lo casteas directo en el query origen; o a su vez usa la información de la metadata del destino y crear un mapping dinámico

Share via

Failure happened source side in copy activity for vertica source.