ADF Salesforce Upsert ignore error and continue sending batches

Zheyi Zhu 21 Reputation points
2022-11-08T23:42:02.347+00:00

Hi,

We are using the salesforce sink through linked service in the copy data, it works most of the time.

When we do upserts, the salesforce side sometimes will send some error back and the batch stops right after.

Is it possible to ignore the error and continue sending the batches?

Thanks!
Z

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,880 questions
0 comments No comments
{count} votes

Accepted answer
  1. HimanshuSinha-msft 19,386 Reputation points Microsoft Employee
    2022-11-09T22:15:57.807+00:00

    Hello @Zheyi Zhu ,
    Thanks for the question and using MS Q&A platform.
    Can you please share the error which you are getting ?
    Looking at the documentation for UPSERT to work you will need set the "externalIdFieldName " have you done that ? Its called out here ?
    https://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce?tabs=data-factory

    258860-image.png

    Unfortunately, I do not have a Salesforce instance to test this scenario, but I would recommend you give a try using the Fault tolerance of copy activity in Azure Data Factory. Using Fault Tolerance feature when you copy data from source to destination store, the copy activity provides certain level of fault tolerances to prevent interruption from failures in the middle of data movement.

    258885-image.png

    We will wait to hear from you . .
    Thanks
    Himanshu

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful