Performance Optimizations for Operations Manager 2007 R2 and 2012
Please Note: This blog has been updated to provide guidance on which settings are applicable to Operations Manager 2012.
This blog post is based on questions that people who attended our MMS 2010 session BB23 – Operations Manager 2007 SQL Server Configuration for Operations Manager 2007 Administrators. You know as I was typing the name of the session, I realize it is way too wordy. In retrospect I could have simply named it, “Optimizing SQL Server for Operations Manager 2007”. Here Chris Cubley and I delivered this at our internal TechReady conference in June with some spit and polish applied, and I did not think of it then. I digress…okay moving on
In our session we covered optimizations that are specific to Operations Manager 2007 R2 and these optimizations are applicable to a management group supporting an enterprise scenario (1,000 – 6,000+ agents). There is no performance benefit to be gained if you apply these settings to a management group that is managing less than 1,000 agents.
Management Server Health Service - OM 2007 R2
The recommended settings highlighted in this section are only applicable to Operations Manager 2007 R2. In Operations Manager 2012, the default settings for these Registry keys for the Health Service have higher values and are already optimized out of the box (at this point).
The following are specific settings with recommended values from the product group based on their performance and scalability tests that can reduce resource utilization on the SQL Servers hosting the Operations Manager databases, and the management servers/Root Management Server:
To reduce resource utilization impact on the Root Management Server and management servers caused by the OpsMgr queues, perform these changes on the RMS/MS’s in the management group:
Registry Path |
Registry Value (DWORD) |
HKLM\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\Persistence Cache Maximum |
102400 |
HKLM\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\Persistence Version Store Maximum |
10240 |
HKLM\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\State Queue Items (See note below) |
20480 |
HKLM\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\Persistence Checkpoint Depth Maximum |
104857600 |
Note: This key does not exist by default and must be created manually.
Management Servers Config Service and Group Membership Calculation - OM 2007 R2 and OM 2012
In an Operations Manager 2007 R2 management group, to reduce resouce utilization on an Operations Manager 2007 R2 Root Management Server, perform the changes highlighted in the following table. In an Operations Manager 2012 management group, only perform modify the Group Calculation Polling Interval highlighted in the following table on all management servers that are a member of the "All Management Servers Resource Pool" (which technically is every management server deployed in your management group, unless you have dedicated one or more management servers to a custom-defined pool for Network Device or Cross-Platform monitoring and have manually assigned management servers to the "All Management Servers Resource Pool"). The Config Service Polling Interval setting is not relevant to Operations Manager 2012, as the configuration settings related to the Config Service are defined in the ConfigService.Config xml file and there are a few modifications required in order to modify the polling interval. This is noted in Kevin Holman's blog article.
Registry Path |
Registry Value (DWORD) |
HKLM\SOFTWARE\Microsoft\Microsoft Operations Manager\3.0\Config Service\Polling Interval Seconds |
00000078 (2 minutes) |
HKLM\SOFTWARE\Microsoft\Microsoft Operations Manager\3.0\GroupCalcPollingIntervalMilliseconds |
000dbba0 (15 minutes) |
Note: These Registry keys do not exist by default and must be created manually.
Before changing the Group Calculation interval I should point out a few things to help you make a well informed decision. By default group calculation is performed on the RMS every 30 seconds. In a management group supporting the enterprise scenario, you will typically see many custom groups defined for targeting overrides, scoping of user roles, and for controlling the behavior of notification subscriptions (at a minimum). Group calculation discovery rules can impact the performance of the OperationsManager database, as the behavior characteristics are queries run against the database instance space in the form of multiple read operations. If you have lot of groups and their group calculation criteria are complex, it will have a big hit on database performance. Other operations in the management group could be affected as well, such as slower discovery insertion, degraded console performance, and replication of configuration changes to agents is slower. Precisely how much degradation you’ll see in these other areas is predicated upon how much group calculation is overloaded.
Changing the calculation interval to a greater value could affect any overrides that target a group, since an object that would fall under the criteria of a group would not relate to that group and receive the override until the group calculation is performed. If you can tolerate the latency of group membership discovery, then you can increase the interval/frequency to a less frequent schedule, say every four or eight hours as an example.
Data Warehouse Synchronization - OM 2007 R2 and 2012
For reduced resource utilization impact on the OperationsManager databases caused by DW synchronization rules running on the RMS in an Operations Manager 2007 R2 management gorup or the management servers in an Operations Manager 2012 management gorup, create overrides in the Operations Manager console for the following rules to increase the interval and batch size of those operations:
Class |
Rule/Monitor Name |
Override Parameter |
Override Value |
Data Warehouse Synchronization Server |
Data Warehouse monitor initial state synchronization rule |
Batch Generation Frequency Seconds |
300 |
Data Warehouse monitor initial state synchronization rule |
Batch Size |
1000 |
|
Data Warehouse object synchronization rule |
Batch Generation Frequency Seconds |
300 |
|
Data Warehouse object synchronization rule |
Batch Size |
1000 |
|
Data Warehouse report deployment rule |
* Management Pack List Frequency Seconds |
600 |
|
Data Warehouse report deployment rule |
*Management Pack List Frequency Seconds |
550 |
|
Data Warehouse report deployment rule |
*Management Pack List Frequency Seconds |
500 |
|
Data Warehouse managed object type synchronization rule |
Batch Generation Frequency Seconds |
300 |
|
Data Warehouse managed object type synchronization rule |
Batch Size |
1000 |
|
Data Warehouse relationship synchronization rule |
Batch Generation Frequency Seconds |
300 |
|
Data Warehouse relationship synchronization rule |
Batch Size |
1000 |
*Note: This override parameter actually affects three data sources referenced in this rule.
Console Refresh - OM 2007 R2 and OM 2012
The Operations Manager Console refresh interval is every 15 seconds by default. With multiple consoles in an enterprise scenario, this can negatively impact performance. For best performance, turning off Polling or increasing the interval can help. Perform this change on any Windows computer that has the console installed:
Registry Path |
Registry Value (DWORD) |
HKCU\Software\Microsoft\Microsoft Operations Manager\3.0\console\CacheParameters\ PollingInterval |
0 – 10 (0 turns off automatic refresh and requires manual refresh via F5. The value 1 through 10 increments the refresh interval every 15 seconds. The maximum value of 10 is a refresh interval of 2 min 30 seconds). |
Before making any changes, always test first and evaluate the results before implementing them in production. If you make them in production due to constraints in being able to appropriately test/validate in your test lab, first establish a performance baseline before making any of the proposed changes stated here. After each change, perform another performance measurement and compare it to the initial baseline statistics to determine if the results are above or below the baseline.
Comments
Anonymous
January 01, 2003
Would you recommend upping of these numbers for 8500 agents? BrianAnonymous
January 01, 2003
The comment has been removedAnonymous
September 13, 2010
The comment has been removedAnonymous
January 12, 2011
Hi Matt Thanks for the great article. One thing, can you confirm if the registry values are Hex or Decimal values please ? Many Thanks TrevorAnonymous
January 12, 2011
Matt, thanks for this post. We have large deployment and implemented some complex group membershiprules, so this is very handy. Question, are you sure the key 'HKLMSYSTEMCurrentControlSetServicesHealthServiceParametersPersistence Checkpoint Depth Maximum' is 104857600 and not 10485760? Default setting is 20971520. 10485760 is a 50% decrease. 104857600 is 500% increase. Thanks, MichielAnonymous
January 16, 2011
Trevor, The Registry values are in decimal format.Anonymous
January 19, 2011
The comment has been removedAnonymous
June 04, 2012
is there such a modification available for SCOM2012, too?Anonymous
September 19, 2012
I'll be updating ths blog tonight to share details on what is/what isn't applicable for OM 2012. Stay tuned!Anonymous
May 02, 2013
Hello Matt, "first establish a performance baseline before making any of the proposed changes stated here" Do you have a list of reports/views which will give us the picture of the environemnt for this purpose. Thanks, DomAnonymous
December 28, 2013
Here’s a new Knowledge Base article we published today on SCOM 2007. This one talks about configurationAnonymous
December 28, 2013
Pingback from How to detect and troubleshoot frequent configuration changes in Operations Manager 2007 - Safranka M??ty??s szakmai blogja - TechNetKlubAnonymous
December 28, 2013
Pingback from How to detect and troubleshoot frequent configuration changes in Operations Manager 2007 - System Center Mindenkinek - TechNetKlubAnonymous
January 17, 2014
A small, but usefull link collection to use for configuration and upgrading System Center OperationsAnonymous
March 19, 2014
The Registry Path does not exist in scom 2012!!!Anonymous
April 01, 2014
I'm using SCOM 2007 R2, In my alert view if I change the resolution state value let's say from New to Acknowledged and save the changes. The console don't reflect this change as being made. This behavior is consistent on several different consoles and if I double click the alert it do show correctly but the console is still not updated. Do anyone have any suggestions?Anonymous
June 25, 2014
There are many articles on tweaking certain registry settings for SCOM agents, Gateways, and ManagementAnonymous
April 14, 2016
I do miss the parameter Maximum Global Pending Data Count in this blog.
Also, i'm having doubts about Persistence Cache Maximum
In this PDF ( http://download.microsoft.com/download/8/2/8/828C05A2-E6A0-436A-9AE1-704A8005E355/9780735695825.pdf ) they say;
Another important setting is Persistence Cache Maximum of type DWORD. This setting controls the amount of memory in pages used by Persistence Manager for its data store on the local database. The default value for this is 262144 (decimal), which is also the recommended value. If you are running an older version of Operations Manager on management servers that manage a large number of objects, you should change the value to 262144 (decimal).
The default and recommended values are the same here, i think that is a mistake, but still the numbers are much higher than addressed here (102400).Anonymous
April 14, 2016
Persistence Version Store Maximum
The default according to https://support.microsoft.com/en-us/kb/975057 is 5120 (80 megabytes) for a Management Server.
This seems very low to me. The recommended value from this blog is 10240, which seems too low as well. I've set this to 131072 (which is 2GB i believe) which according to the pdf i posted above is the default!
Persistence Manager also stores different versions of the data store. The DWORD Persistence Version Store Maximum setting controls how much memory (in pages) the version store can have. The default value is 131072 (decimal). On management servers where you have increased the value for Persistence Cache Maximum, you might also want to increase the value of Persistence Version Store Maximum.