Data factory V2 and Salesforce Big Object Error

Marianne Segooa 1

Hello

I am using the copy data activity in data factory v2 to get data from salesforce into a database using the salesforce connector and get the below error.

I am accessing to different objects, one runs successfully and the other gives the below error.

I checked the configuration, they are the same. I am not sure what I am doing wrong, please help

Operation on target "" failed: Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][Support] (50100) Conversion from string to unsigned number failed with value '-1',Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][Support] (50100) Conversion from string to unsigned number failed with value '-1',Source=Microsoft Salesforce ODBC Driver,'

KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-07-13T21:10:10.64+00:00
Hi @Marianne Segooa ,

Welcome to Microsoft Q&A platform and thanks for your query.

Could you please tell us what is the sink of your copy activity? Also would you please share below details for further analysis.

Failed pipeline runID?

Failed activity runID?

Data factory region?

What is the IR used?

----------

Thank you
Marianne Segooa 1 Reputation point

2020-07-14T09:55:38.127+00:00

Hi @KranthiPakala-MSFT

The sink is an azure sql database , please see below the details:

Failed pipeline runID : a0c2592f-6b3e-43eb-a222-45de91765fc6

Failed activity runID : edb53a97-c6cc-42d7-b5ee-95b17cf93d3c

Data factory region : South Africa North

What is the IR used : DefaultIntegrationRuntime (North Europe)

I have 2 objects I am pulling from SF, the one is a normal object and runs successfully but the big object fails.

Thank you for your assistance.
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-07-14T23:37:21.823+00:00

Hi @MarianneSegooa-4081,

Thanks for sharing the details. I will further investigate and will get back as soon as I have my findings ready.
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-07-15T04:24:39.45+00:00

Hi @Marianne Segooa ,

Thank you for your patience. After having initial investigation, it is determined that it needs a deeper analysis and I have escalated this to ADF engineering team. I'll keep you posted as soon as I have the next update from the team.

Apologies for the inconvenience.

----------

Thank you
Marianne Segooa 1 Reputation point

2020-07-15T18:44:39.06+00:00

Hi @KranthiPakala-MSFT

Thank you for the feedback so far.

Regards
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-07-21T18:34:16.047+00:00

Hi @Marianne Segooa ,

Just wanted to update you that our internal team is actively collaborating with driver team to figure out the root cause of the issue. Will keep you posted as soon as I have the next update.

Thank you for your patience.
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-07-31T20:08:18.617+00:00

Hi @Marianne Segooa ,

Just wanted to let you know that the drive team is still investigating on this issue. I will keep you posted once I have an update from them.

Thank you.
Marianne Segooa 1 Reputation point

2020-08-08T12:50:51.263+00:00

Hi @KranthiPakala-MSFT

Thank you for the update

Regards
Marianne
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-08-21T19:06:53.37+00:00

Hi @Marianne Segooa ,

Update: The Driver team was able to identify an issue in Salesforce connector. Currently the driver team is working on deploying a fix for this issue. Will keep you posted once I have the next update.

Thank you
Praveen Thangaraj 1 Reputation point

2020-08-31T12:21:22.463+00:00

Hi @KranthiPakala-MSFT , we also faced exactly same issue with salesforce big object "lightningurievent". could you please confirm when the fix will be deployed

Failed pipeline runID : 15dcc102-8fa6-4d9a-a6cd-f2c98b26c306

Failed activity runID: 1e9d7807-68e2-4dc5-a02f-adefc9f129a5

Data factory region: Australia East

What is the IR used: DefaultIntegrationRuntime (Australia Southeast)
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-08-31T20:03:06.387+00:00

Hi @Praveen Thangaraj ,

Thanks for using this forum and reaching out on your query.

I have been following up with internal team regarding the fix for this issue. Will keep you posted as soon as we have the next update from the team. As well as will update this thread once I have an ETA for the deployment.

Sorry for your experience with this issue and thank you for your patience.

6 answers

Anonymous

2021-01-26T09:38:39.13+00:00

Hi @KranthiPakala-MSFT ,
I am facing this issue too now when querying Big Data objects. Do you have any update on progress as this is a production pipeline that we are now failing to pull data for. It was working for a number of weeks before breaking.
Thanks

Error Message:
Failure happened on 'Source' side. 'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=A database operation failed. Please search error to get more details.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][Support] (50100) Conversion from string to unsigned number failed with value '-1',Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][Support] (50100) Conversion from string to unsigned number failed with value '-1',Source=Microsoft Salesforce ODBC Driver,'
Please sign in to rate this answer.

2 people found this answer helpful.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-09-01T21:11:22.367+00:00

Hi @Marianne Segooa , @Praveen Thangaraj ,

Update: A work item was created by ADF product team to fix the driver issue and it is expected to be deployed around mid September (Note: This is a tentative date). Once the fix is deployed, this issue should be resolved. I am monitoring the work item closely and will keep this thread posted once the fix is applied.

Please feel free to let us know if you have further queries.

Apologies for the inconvenience and thank you for your patience.

----------

Thanks & Stay safe
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Piotr Grygiel 1 Reputation point

2020-09-05T23:23:59.797+00:00

Hi KranthiPakala-MSFT.
I'm experiencing the same error details below.
Would You be able to provide an estimate when this fix will be applied?

:
errorCode": "2200",
"message": "Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][Support] (50100) Conversion from string to unsigned number failed with value '-1',Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][Support] (50100) Conversion from string to unsigned number failed with value '-1',Source=Microsoft Salesforce ODBC Driver,'",
"failureType": "UserError",
"target": "ppl_crms_auditlogbo_gxp_full",
"details": []
}
Please sign in to rate this answer.
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-09-08T16:38:09.073+00:00

Hi @Piotr Grygiel ,

Sorry for your experience. As per the latest update from internal team, the fix for this issue will go live before end of this month - September (Note: this is a tentative date).
I have been closely monitoring the work item for the fix. Will keep this thread posted as soon as I have the next update on this.

Thank you for your patience and apologies for the inconvenience caused.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-09-21T16:48:20.297+00:00

Hi @Marianne Segooa , @Praveen Thangaraj , @Piotr Grygiel ,

Update: ADF product confirmed that the fix for the above issue has been released. Could you please validate and let us know if you see any issues.

Looking forward to your confirmation
Thank you for your patience.

----------

Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.
Please sign in to rate this answer.
Dileep, Mittapalli 1 Reputation point

2020-09-23T11:21:01.923+00:00

Hi Team,

We are still facing the same issue. Could someone please check and confirm if this has fixed for anyone?

Thanks
Dileep

Praveen Thangaraj 1 Reputation point

2020-09-29T02:16:33.027+00:00

Hi @KranthiPakala-MSFT , we are still facing the same error.could you please check and confirm

KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-09-29T21:13:15.68+00:00

Sorry for the delay in my response @Dileep, Mittapalli , @Praveen Thangaraj .
Could you please share below details along with complete error message, so that I can re-escalate to ADF product team.

Failed pipeline runID?

Failed activity runID?

Data factory region?

What is the IR used?

Looking forward to your response.
Apologies for the inconvenience caused because of this issue.

Thank you.

Praveen Thangaraj 1 Reputation point

2020-09-30T11:22:19.057+00:00

Hi @KranthiPakala-MSFT , I raise a microsoft ticket and your support team is investigating. I will update you once that has been resolved. thanks

Dileep, Mittapalli 1 Reputation point

2020-09-30T17:38:17.697+00:00

Hi @KranthiPakala-MSFT , Even I have raised the ticket with Microsoft and support team is working with driver team on this. I have provided driver logs also.

KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee

2020-09-30T17:52:26.7+00:00

Hi @Dileep, Mittapalli , @Praveen Thangaraj ,

Thanks for raising a SR with Microsoft. Yes, this definitely requires driver team involvement. Could you please share the SR# with me so that I can track them internally.

Sorry for your experience and we appreciate your patience.

James Brand 1 Reputation point

2020-11-26T13:42:37.53+00:00

@KranthiPakala-MSFT Has there been any progress on this? I am also facing the same issue when trying to query a SF Big Object

Piotr Grygiel 1 Reputation point

2021-02-08T08:46:49.557+00:00

Unfortunately we observed that the problem started to appear again - after initial fix it was working fine and now (for sure after 25th Dec) we are receiving the initial error:

Data factory region : ie1crmsadfp001 region North Europe
Pipeline runID 627c536f-8fc2-42f6-b9dc-2e3f83b30d1e
Activity run id: 0c6781f1-368d-44da-968b-ec285b6d22a1

Please advice what the solution can be?

Error:
Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [Microsoft][Support] (50100) Conversion from string to unsigned number failed with value '-1',Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][Support] (50100) Conversion from string to unsigned number failed with value '-1',Source=Microsoft Salesforce ODBC Driver,'
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
James Brand (intellihub) 1 Reputation point

2021-02-08T11:49:06.047+00:00

@Anonymous ,
We have had the same issue. In the end we worked around with by writing our own custom activity and calling that from ADF2
Please sign in to rate this answer.
Piotr Grygiel 1 Reputation point

2021-02-08T12:50:34.79+00:00

@James Brand (intellihub)
Hi James Could You share Your Approach in little more details?
Regards Piotr
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Data factory V2 and Salesforce Big Object Error

6 answers

Your answer