Hello @Sander de Jong ,
Thanks for the question and using MS Q&A platform.
My understanding is that you are trying to update/upsert the records in Salesforce using ADF salesforce connector inside a copy activity. And you are noticing updates for few records are failing and you would like to know the list of records that are having issue with updates. Please correct me if I'm not clear.
This ask looks similar to the question here: DataFactory Salesforce Linked service: all updates fail if one fails. How to change that behavior?
Unfortunately, I do not have a Salesforce instance to test this scenario, but I would recommend you give a try using the Fault tolerance of copy activity in Azure Data Factory
. Using Fault Tolerance feature
when you copy data from source to destination store, the copy activity provides certain level of fault tolerances to prevent interruption from failures in the middle of data movement.
In addition, you can also configure to log the incompatible rows. And once after the copy activity run completes, you can see the number of skipped rows in the output of the copy activity. you can find the log file from this path: https://[your-blob-account].blob.core.windows.net/[path-if-configured]/copyactivity-logs/[copy-activity-name]/[copy-activity-run-id]/[auto-generated-GUID].csv
. Two more columns "ErrorCode" and "ErrorMessage" in additional to the original source data are added in the log file.
To know more about the Fault tolerance of copy activity, please refer to this document: Fault tolerance of copy activity in Azure Data Factory and Synapse Analytics pipelines
Hope this will help. Do let us know how it goes or if you have any questions.
Thank you
----------
- Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
- Want a reminder to come back and check responses? Here is how to subscribe to a notification
- If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators