Concurrancy exception for delta table merge operation spark error

Question

Hello, I have an application that runs daily through a trigger, without problems. The fact is that my Synapses environment is returning a writing error with concurrency, but I am 100% sure that this concurrency does not exist, is there some kind of error in Synapses or Spark Clusters related to Synapses in any region?

Answer 1

Hello @Vitor Gallicchio

Resolution from OP (Vitor Gallicchio) Posting as Answer, to help other find this resolution.

Ok, just to update the output was to make a backup of the tables and rewrite them, from there the trigger process today occurred normally. In case someone goes through this maybe this is the only way to fix it.

The error message you provided indicates that there was a concurrent update to the root of the table, which caused a conflict with your operation.

In Synapse Analytics, are you sure multiple processes or threads are not running simultaneously and accessing shared resources like data storage or compute resources?

Troubleshooting Steps

1. To avoid this issue, you can try to limit the number of concurrent writes to the table.
2. You can also try to optimize your queries to reduce the amount of data that needs to be written to the table.
3. You can also check the Spark Cluster logs to see if there are any errors or warnings related to concurrency.

If the above issue persist, then please submit a technical support ticket with Microsoft, Please let us know if you need further help in this matter, we are happy to help you!