SCDPM 2016 ReplicaConcurrencyCheckFailed

Question

Hi.
We have a problem with SCDPM 2016.
After restart server MSDPM service does not start properly. The database has no any errors and working fine
DbRecovery status is 0 Application log show me this error

The description for Event ID 999 from source MSDPM cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer.

If the event originated on another computer, the display information had to be saved with the event.

The following information was included with the event: 

An unexpected error caused a failure for process 'msdpm'.  Restart the DPM process 'msdpm'.

Problem Details:
<FatalServiceError><__System><ID>19</ID><Seq>1</Seq><TimeCreated>1/18/2024 8:12:51 AM</TimeCreated><Source>DpmThreadPool.cs</Source><Line>163</Line><HasError>True</HasError></__System><ExceptionType>ReplicaConcurrencyCheckFailedException</ExceptionType><ExceptionMessage>Exception of type 'Microsoft.Internal.EnterpriseStorage.Dls.Utils.ReplicaConcurrencyCheckFailedException' was thrown.</ExceptionMessage><ExceptionDetails>Microsoft.Internal.EnterpriseStorage.Dls.Utils.ReplicaConcurrencyCheckFailedException: Exception of type 'Microsoft.Internal.EnterpriseStorage.Dls.Utils.ReplicaConcurrencyCheckFailedException' was thrown.
   at Microsoft.Internal.EnterpriseStorage.Dls.StorageManager.StorageManager.DeallocateStorage(String containerId, Guid storageId, StorageType storageType, StorageParams storageParams)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IntentManager.RefreshForDeallocationScenario(IMCatalogDB imCatalog, DataSourceTranslationStatus dataSourceStatus)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IntentManager.Refresh()
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IntentTranslator.IntentRestart()
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
   at System.Threading.ThreadHelper.ThreadStart()
*** Mojito error was: ReplicaConcurrencyCheckFailed; 0; None</ExceptionDetails></FatalServiceError>

MSDPMCurr.errlog has many warning messages like this

2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	Caught unhandled exception : Microsoft.Internal.EnterpriseStorage.Dls.Utils.ReplicaConcurrencyCheckFailedException: Exception of type 'Microsoft.Internal.EnterpriseStorage.Dls.Utils.ReplicaConcurrencyCheckFailedException' was thrown.
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	   at Microsoft.Internal.EnterpriseStorage.Dls.StorageManager.StorageManager.DeallocateStorage(String containerId, Guid storageId, StorageType storageType, StorageParams storageParams)
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IntentManager.RefreshForDeallocationScenario(IMCatalogDB imCatalog, DataSourceTranslationStatus dataSourceStatus)
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IntentManager.Refresh()
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IntentTranslator.IntentRestart()
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	   at System.Threading.ThreadHelper.ThreadStart()
2DB0	1548	01/19	13:01:10.600	68	DpmThreadPool.cs(121)			WARNING	*** Mojito error was: ReplicaConcurrencyCheckFailed; 0; None
2DB0	1548	01/19	13:01:10.616	68	DpmThreadPool.cs(149)			WARNING	Attempting to write error to the event log Exception of type 'Microsoft.Internal.EnterpriseStorage.Dls.Utils.ReplicaConcurrencyCheckFailedException' was thrown.
2DB0	1548	01/19	13:01:10.632	68	DpmThreadPool.cs(170)			WARNING	Attempting to invoke Watson

Maybe anyone has problem like this and could help with it ?
Thank you in advance

Answer 1

Yes, all services run normally. After hours of exploration I restored dpm database from the early backup. Some backups did not work as well and service fails again. But DB from backup which make 7 days ago works well I lost 7 days backups but now dpm work well. I think this is some bug in DB, but no changes made last month on DPM

Answer 2

Hi,

The DPM service was dependent on the SQL Server and SQL Server Agent services.

Do all services run normally under the domain account?