DPM 2016 event 999 MSDPM error

FNDH 0 Reputation points
2023-02-06T09:34:33.5933333+00:00

Hi , i tried to do a test restore from our Backup server, it timed out the console and ever since when i load the mmc console , it crashed everytime i go to protection or monitoring , here is what i'm seeing in event viewer

log has the following

The description for Event ID 999 from source MSDPM cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer.

If the event originated on another computer, the display information had to be saved with the event.

The following information was included with the event: 

An unexpected error caused a failure for process 'mmc'.  Restart the DPM process 'mmc'.

Problem Details:
<FatalServiceError><__System><ID>19</ID><Seq>0</Seq><TimeCreated>06/02/2023 09:20:01</TimeCreated><Source>DpmThreadPool.cs</Source><Line>163</Line><HasError>True</HasError></__System><ExceptionType>InvalidOperationException</ExceptionType><ExceptionMessage>There is an error in XML document (0, 0).</ExceptionMessage><ExceptionDetails>System.InvalidOperationException: There is an error in XML document (0, 0). ---&gt; System.Xml.XmlException: Root element is missing.
   at System.Xml.XmlTextReaderImpl.Throw(Exception e)
   at System.Xml.XmlTextReaderImpl.ParseDocumentContent()
   at System.Xml.XmlReader.MoveToContent()
   at Microsoft.Xml.Serialization.GeneratedAssembly.XmlSerializationReaderRADataMoveStatusTypeFilesFailedList.Read5_Item()
   --- End of inner exception stack trace ---
   at System.Xml.Serialization.XmlSerializer.Deserialize(XmlReader xmlReader, String encodingStyle, XmlDeserializationEvents events)
   at System.Xml.Serialization.XmlSerializer.Deserialize(TextReader textReader)
   at Microsoft.Internal.EnterpriseStorage.Dls.EngineUICommon.XmlSerializerAux.Deserialize(TextReader textReader)
   at Microsoft.Internal.EnterpriseStorage.Dls.EngineUICommon.RADataMoveStatusTypeFilesFailedListSerializer.DeserializeFailedFiles(String failedFilesString)
   at Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.JobManagement.JobHelper.UpdateFailedFilesList(ErrorInfo errorInfo)
   at Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.Alert.ShadowCopyAlert.UpdateErrorInfo(ErrorInfo errorInfoLocal)
   at Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.Alert.ShadowCopyAlert.CommonConstruct()
   at Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.Alert.ShadowCopyAlert..ctor(OMSqlRetryReader alertreader, AlertReader readerHelper, DpmServer dpmServer)
   at Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.Alert.AlertFactory.CreateAlert(OMSqlRetryReader reader, AlertReader dbReaderHelper, DpmServer server)
   at Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.Alert.AlertController.CollectAlertInlist(AlertReader dbReader, List`1 listOfAlerts, DateTime thresholdTime, Boolean includeResolvedAlerts, DpmServer dpmServer, Hashtable jobIdToBackupFailedAlertCollectionLocal, Hashtable jobIdToDatasetCopyAlertCollectionLocal, Hashtable jobIdToDatasetVerifyAlertCollectionLocal)
   at Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.Alert.AlertController.PopulateFromDatabase(Boolean includeResolvedAlerts, Boolean asyncLoadExternalAlerts)
   at Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.Alert.AlertController.GetAlertsThreadStart(Object state)
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.QueueUserWorkItemCallback.System.Threading.IThreadPoolWorkItem.ExecuteWorkItem()
   at System.Threading.ThreadPoolWorkQueue.Dispatch()</ExceptionDetails></FatalServiceError>


the message resource is present but the message is not found in the string/message table

Operations Manager
Operations Manager
A family of System Center products that provide infrastructure monitoring, help ensure the predictable performance and availability of vital applications, and offer comprehensive monitoring for datacenters and cloud, both private and public.
1,413 questions
0 comments No comments
{count} votes

3 answers

Sort by: Most helpful
  1. XinGuo-MSFT 14,236 Reputation points
    2023-02-07T09:40:14.33+00:00

    Hi,

    Please take a look at the corresponding DPM error log. The default location for these DPM error logs is similar to C:\Program Files\Microsoft System Center 2012\DPM\DPM\Temp\

    The service starts but then crashes

    0 comments No comments

  2. FNDH 0 Reputation points
    2023-02-07T10:41:28.22+00:00

    thanks its not created a crash file since last week , which is odd as i have recreated the issue today and yesterday , file attached MSDPMCurr.errlog.2023-02-04_03-54-03.log

    0 comments No comments

  3. FNDH 0 Reputation points
    2023-02-07T12:13:57.95+00:00

    thanks please mark as closed, managed to get a dpmsync to run finally and its fixed the issue

    0 comments No comments