Alert subscription data source module encountered errors while running.

Chua Liang Wei 181 Reputation points
2021-02-19T01:47:25.693+00:00

we received this alert very frequently but it triggered as once which is related to subscription configured/created. How can we troubleshoot or fix the issue? We tried to restarted the SCOM services. it will retrigger for different subscription after few hours/days

Alert subscription data source module was unable to find alerts that match the subscription because of database errors.

The following error(s) were encountered:

Exception Message: ExecuteScalar requires an open and available Connection. The connection's current state is closed.

One or more workflows were affected by this.

Workflow name: Subscription45044c38_9986_4c55_96df_f661ef441722

Instance name: Alert Notification Subscription Server

Instance ID: {E07E3FAB-53BC-BC14-1634-5A6E949F9230}

Operations Manager
Operations Manager
A family of System Center products that provide infrastructure monitoring, help ensure the predictable performance and availability of vital applications, and offer comprehensive monitoring for datacenters and cloud, both private and public.
1,275 questions
0 comments No comments
{count} votes

Accepted answer
  1. Chua Liang Wei 181 Reputation points
    2021-02-22T01:12:38.437+00:00

    What we can found suspicious log is following.

    Event ID: 26319

    An exception was thrown while processing GetObjectsFromReader for session ID uuid:121a46a7-3e87-4293-bcec-8a3a18e140b3;id=9.
    Exception message: A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 0 - An existing connection was forcibly closed by the remote host.)
    Full Exception: A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 0 - An existing connection was forcibly closed by the remote host.)

    Failed to store data in the Data Warehouse. The operation will be retried.
    Exception 'SqlException': Management Group with id ''DB0CCB3A-5A86-6EBE-0C65-3E0C39CBB2E0'' is not allowed to access Data Warehouse under login ''domain\XXXX''


3 additional answers

Sort by: Most helpful
  1. System Center guy 676 Reputation points
    2021-02-19T03:38:08.443+00:00

    please check
    i) Any pattern the alerts generated such as it were starting around at 8:00 pm and ended some time after 11:00 pm.
    ii) looking through the OperationsManager event log

    ii) check any performance issue between the management server and the database server.

    Roger

    0 comments No comments

  2. Chua Liang Wei 181 Reputation points
    2021-02-20T07:51:07.38+00:00

    no performance issue, it happened so random, everytime is different subscriptions

    0 comments No comments

  3. CyrAz 5,171 Reputation points
    2021-02-20T14:24:10.893+00:00

    Assuming the message isn't bogus, it's pretty clear : for some reason, the database is unreachable at the moment the subscription triggers.
    So maybe you could look for other events and logs (in windows and SQL) that could confirm this, and provide more info about why.

    0 comments No comments