DataFactory Salesforce Linked service: all updates fail if one fails. How to change that behavior?

Sander de Jong 6 Reputation points
2022-03-10T08:05:43.767+00:00

When the Linked service sends multiple records to update in Salesforce and one update fails, all updates fail. How to change this? I would really like all other updates to succeed. I cannot find a switch that allows me to choose that option.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
0 comments No comments
{count} vote

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,442 Reputation points Microsoft Employee
    2022-03-11T00:39:58.047+00:00

    Hello @Sander de Jong ,

    Thanks for the question and using MS Q&A platform.

    My understanding is that you are trying to update/upsert the records in Salesforce using ADF salesforce connector inside a copy activity. And you are noticing updates for few records are failing and you would like to know the list of records that are having issue with updates. Please correct me if I'm not clear.

    This ask looks similar to the question here: DataFactory Salesforce Linked service: all updates fail if one fails. How to change that behavior?

    Unfortunately, I do not have a Salesforce instance to test this scenario, but I would recommend you give a try using the Fault tolerance of copy activity in Azure Data Factory. Using Fault Tolerance feature when you copy data from source to destination store, the copy activity provides certain level of fault tolerances to prevent interruption from failures in the middle of data movement.

    181997-image.png

    In addition, you can also configure to log the incompatible rows. And once after the copy activity run completes, you can see the number of skipped rows in the output of the copy activity. you can find the log file from this path: https://[your-blob-account].blob.core.windows.net/[path-if-configured]/copyactivity-logs/[copy-activity-name]/[copy-activity-run-id]/[auto-generated-GUID].csv

    To know more about the Fault tolerance of copy activity, please refer to this document: Fault tolerance of copy activity in Azure Data Factory and Synapse Analytics pipelines

    Hope this will help. Do let us know how it goes or if you have any questions.

    Thank you

    ----------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments