SCOM 2019 UR3 Console error - The client has been disconnected from the server.

Tony Strother 171 Reputation points
2021-12-06T19:09:11.073+00:00

The following was copied to the clipboard. I get the error when doing work with Groups.

Date: 12/6/2021 12:58:47 PM
Application: Operations Manager
Application Version: 10.19.10505.0
Severity: Error
Message:

Microsoft.EnterpriseManagement.Common.ServerDisconnectedException: The client has been disconnected from the server. Please call ManagementGroup.Reconnect() to reestablish the connection. ---> System.ServiceModel.CommunicationObjectFaultedException: The communication object, System.ServiceModel.Channels.ServiceChannel, cannot be used for communication because it is in the Faulted state.

Server stack trace:
at System.ServiceModel.Channels.CommunicationObject.ThrowIfFaulted()
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.EnterpriseManagement.Common.Internal.IDispatcherService.DispatchUnknownMessage(Message message)
at Microsoft.EnterpriseManagement.Common.Internal.EntityObjectsServiceProxy.PerformGroupMembershipDiscoverySnapshot(String managementPackXml)
--- End of inner exception stack trace ---
at Microsoft.EnterpriseManagement.Common.Internal.ExceptionHandlers.HandleChannelExceptions(Exception ex)
at Microsoft.EnterpriseManagement.Common.Internal.EntityObjectsServiceProxy.HandleChannelExceptions(String methodName, Exception ex)
at Microsoft.EnterpriseManagement.Common.Internal.EntityObjectsServiceProxy.PerformGroupMembershipDiscoverySnapshot(String managementPackXml)
at Microsoft.EnterpriseManagement.Internal.UI.Authoring.Extensibility.DiscoveryPagesManager.UpdateGroupMembersJob(Object sender, ConsoleJobEventArgs e)
at Microsoft.EnterpriseManagement.Mom.Internal.UI.Console.ConsoleJobExceptionHandler.ExecuteJob(IComponent component, EventHandler`1 job, Object sender, ConsoleJobEventArgs args)
System.ServiceModel.CommunicationObjectFaultedException: The communication object, System.ServiceModel.Channels.ServiceChannel, cannot be used for communication because it is in the Faulted state.

Server stack trace:
at System.ServiceModel.Channels.CommunicationObject.ThrowIfFaulted()
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.EnterpriseManagement.Common.Internal.IDispatcherService.DispatchUnknownMessage(Message message)
at Microsoft.EnterpriseManagement.Common.Internal.EntityObjectsServiceProxy.PerformGroupMembershipDiscoverySnapshot(String managementPackXml)

Console is run from the RMS vis RDP to the server. I have looked at other threads, Time is ok, Default Management Pack looks ok, though it has many languages other than English in it, no other errors that I can see. Looking in the Event log on the RMS I see a whole lot of Event ID: 26319, which is very confusing to lookup.
Date: 12/6/2021 12:58:47 PM
Application: Operations Manager
Application Version: 10.19.10505.0
Severity: Error
Message:

Microsoft.EnterpriseManagement.Common.ServerDisconnectedException: The client has been disconnected from the server. Please call ManagementGroup.Reconnect() to reestablish the connection. ---> System.ServiceModel.CommunicationObjectFaultedException: The communication object, System.ServiceModel.Channels.ServiceChannel, cannot be used for communication because it is in the Faulted state.

Server stack trace:
at System.ServiceModel.Channels.CommunicationObject.ThrowIfFaulted()
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.EnterpriseManagement.Common.Internal.IDispatcherService.DispatchUnknownMessage(Message message)
at Microsoft.EnterpriseManagement.Common.Internal.EntityObjectsServiceProxy.PerformGroupMembershipDiscoverySnapshot(String managementPackXml)
--- End of inner exception stack trace ---
at Microsoft.EnterpriseManagement.Common.Internal.ExceptionHandlers.HandleChannelExceptions(Exception ex)
at Microsoft.EnterpriseManagement.Common.Internal.EntityObjectsServiceProxy.HandleChannelExceptions(String methodName, Exception ex)
at Microsoft.EnterpriseManagement.Common.Internal.EntityObjectsServiceProxy.PerformGroupMembershipDiscoverySnapshot(String managementPackXml)
at Microsoft.EnterpriseManagement.Internal.UI.Authoring.Extensibility.DiscoveryPagesManager.UpdateGroupMembersJob(Object sender, ConsoleJobEventArgs e)
at Microsoft.EnterpriseManagement.Mom.Internal.UI.Console.ConsoleJobExceptionHandler.ExecuteJob(IComponent component, EventHandler`1 job, Object sender, ConsoleJobEventArgs args)
System.ServiceModel.CommunicationObjectFaultedException: The communication object, System.ServiceModel.Channels.ServiceChannel, cannot be used for communication because it is in the Faulted state.

Server stack trace:
at System.ServiceModel.Channels.CommunicationObject.ThrowIfFaulted()
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.EnterpriseManagement.Common.Internal.IDispatcherService.DispatchUnknownMessage(Message message)
at Microsoft.EnterpriseManagement.Common.Internal.EntityObjectsServiceProxy.PerformGroupMembershipDiscoverySnapshot(String managementPackXml)

I could really use some pointers on this if someone has any ideas...
Thank you,
Tony

Operations Manager
Operations Manager
A family of System Center products that provide infrastructure monitoring, help ensure the predictable performance and availability of vital applications, and offer comprehensive monitoring for datacenters and cloud, both private and public.
1,395 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. AlexZhu-MSFT 5,236 Reputation points Microsoft Vendor
    2021-12-07T07:08:40.58+00:00

    Hi,

    Error 26319 is generic and I'm afraid we can't find more detailed information. Since this error appears when doing work with groups, we may list out the recent manually created groups and delete them to see if it helps.

    get-scomgroup | sort-object -property lastmodified -descending | select-object healthstate, displayname, lastmodified, lastmodifiedby -first 10

    If we want to more control of OpsMgr, we may refer to:
    OpsMgrExtended 1.3.0
    https://www.powershellgallery.com/packages/OpsMgrExtended/1.3.0

    155611-scom-get-group.png

    Alex

    If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    0 comments No comments

  2. Andrew Blumhardt 9,461 Reputation points Microsoft Employee
    2021-12-07T12:56:00.227+00:00

    It could be an issue with the management server or the Operations Database. Reboot the management server and check the Operations Manager event log for unexpected errors. Verify that all of the connected management servers are healthy. Check the Operations Database for availability issues. I expect this will go away after one or both are rebooted.

    0 comments No comments