DataFactory Salesforce Linked service: how to find out which record update failed?

Sander de Jong 6 Reputation points
2022-03-10T08:03:07.81+00:00

The Linked service tries to update thousands of Account records. One or more updates fail due to validation errors. DataFactory reports which validation errors, but it doesn't say which records. How can I find out what records failed?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,958 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,592 Reputation points Microsoft Employee
    2022-03-11T00:46:58.197+00:00

    Hello @Sander de Jong ,

    Thanks for the question and using MS Q&A platform.

    My understanding is that you are trying to update/upsert the records in Salesforce using ADF salesforce connector inside a copy activity. And you are noticing updates for few records are failing and you would like to know the list of records that are having issue with updates. Please correct me if I'm not clear.

    This ask looks similar to the question here: DataFactory Salesforce Linked service: all updates fail if one fails. How to change that behavior?

    Unfortunately, I do not have a Salesforce instance to test this scenario, but I would recommend you give a try using the Fault tolerance of copy activity in Azure Data Factory. Using Fault Tolerance feature when you copy data from source to destination store, the copy activity provides certain level of fault tolerances to prevent interruption from failures in the middle of data movement.

    181997-image.png

    In addition, you can also configure to log the incompatible rows. And once after the copy activity run completes, you can see the number of skipped rows in the output of the copy activity. you can find the log file from this path: https://[your-blob-account].blob.core.windows.net/[path-if-configured]/copyactivity-logs/[copy-activity-name]/[copy-activity-run-id]/[auto-generated-GUID].csv . Two more columns "ErrorCode" and "ErrorMessage" in additional to the original source data are added in the log file.

    To know more about the Fault tolerance of copy activity, please refer to this document: Fault tolerance of copy activity in Azure Data Factory and Synapse Analytics pipelines

    Hope this will help. Do let us know how it goes or if you have any questions.

    Thank you

    ----------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.