Riham Selim's Blog https://docs.microsoft.com/archive/blogs/rihamselim/feed.xml Wed, 17 Apr 2019 03:12:56 GMT en-US hourly 1 Enabling alerts for Custom Fields in Work Item Alerts https://docs.microsoft.com/archive/blogs/rihamselim/enabling-alerts-for-custom-fields-in-work-item-alerts Wed, 07 Sep 2016 14:21:39 GMT https://blogs.msdn.microsoft.com/rihamselim/?p=365 UPDATE: The information in this blog post is deprecated as a new team owns this feature now - The feature is expected to be publicly available soon - another update will be posted when it becomes available ------------------------------------------------------------------------------------------------------------------------------------------------- Right now when you create work item alerts some fields like priority will only limit you to "changes, changes from and changes to" operators, these are what's called custom fields (as opposed to core fields). Many customers have asked about a way to enable remaining operators for these fields, we have been working on enabling this feature, the changes are already part of TFS15  (Not the same as TFS 2015  - see https://blogs.msdn.microsoft.com/bharry/2016/08/08/tfs-15-rc1-is-available/) and VisualStudioOnline.com This hasn't been enabled publicly yet because of the significant impact it can have on the workload for customers with lots of custom fields. If you are interested in being an early adopter let us know, you can contact me at rihams at microsoft dot com and I will be glad to provide instructions. If you are using Visual Studio Team Services we can enable this feature for your account. Feature Disabled: alerts before Feature Enabled: alerts after]]> Troubleshooting issues with Visual Studio Team Services and TFS Notifications / Alerts https://docs.microsoft.com/archive/blogs/rihamselim/troubleshooting-issues-with-visual-studio-team-services-and-tfs-notifications-alerts Tue, 23 Aug 2016 16:12:44 GMT https://blogs.msdn.microsoft.com/rihamselim/?p=305 Set alerts and get notified when changes occur. One of the common issues that occur with these alerts is that users who are expecting to get a certain form of alert / notification do not get it, this guide is meant to help troubleshoot these issues. Problem 1: I am expecting to get an alert but I am not getting one
  • If you are using TFS 2015 Update2 and having issues with Code Review events, you need to update to TFS 2015 Update2.1
  • First thing to check is to make sure a notification is actually expected. If you use the existing subscription templates and you are the one making the changes then it's most likely expected that you will not get a notification, this is by far the most common reason alerts are being discarded
    • For example, when you create a "My work Items are changed by others" subscription, by default there will be a clause in the subscription that says "And Authorized As" <> [Me], this translates to (And the person making the change is not me), this ensures that the user making a change to a work item isn’t then notified about the change. Most users don’t want an email telling them they just did something
    • For testing purposes, try removing this clause and seeing if things are working for you now
wit changed by others          wit_assigned to me  
  • If you still see issues, check if there are any failures in the JobHistory by running this query against your config DB
  • SELECT TOP 100
 JobSource,
 JobId,
 QueueTime,
 StartTime,
 EndTime,
 Result,
 ResultMessage
FROM tbl_JobHistory
WHERE JobId IN
(
'A4804DCF-4BB6-4109-B61C-E59C2E8A9FF7', -- event processing
'A96D6177-BEEF-477A-A2EE-2C31433214D0', -- email, soap, etc. delivery
'A0C22F34-652E-4B9C-A06B-3F4AFE4BE458' -- service hooks delivery
)
AND Result <> 0
ORDER BY StartTime DESC
  • Check the Message column, this should give you more details about the reasons for the errors.
    • If it has a security/permissions error then check that your SMTP user/password are correct.
    • If it has SOAP errors or ServiceUnavailable exceptions then your SOAP endpoint is misconfigured.
  • Are you using VS 2013 client to make Work Item / code review changes, and your subscription has some "Identity" fields, e.g. Work Item Assigned to = [Me], Reviewers Contains [Me], etc? If so then unfortunately this might be caused by a bug with VS2013, the bug has been fixed in Update 3.
  • When all else fails
    • Starting TFS Update 2.1 you can enable detailed subscription tracing in TFS - Please Note that this is for advanced troubleshooting only, so it is not a supported method for troubleshooting , it might be easier at this point to file a connect bug through https://connect.microsoft.com/, or you can email me to help analyze the traces (rihams @ microsoft dot com)
      • Get the Subscription Id either by double clicking on the subscription or from any previous email from this same subscription

        1-    Run this on the configuration database (mine is called tfs_Configuration)

                   EXEC prc_CreateTrace @traceid = '5c3da495-1ded-4916-bc48-4d58fc52d3d4' , @userDefined='Subscription79'   --Replace 79 with the id of the subscription that is not working, you can get it by double clicking on the subscription in the UI

        2-     Reproduce the issue by generating an event that you expect to see an email from 3-     Disable the trace to avoid generating too much noise, On Configuration database run:          EXEC prc_DeleteTrace '5c3da495-1ded-4916-bc48-4d58fc52d3d4' 4 -     On the Job Agent machine, open event viewer -> Applications and Service Logs --> Microsoft-Team Foundation Server --> Debug 5-     Filter the log to show only errors and verbose

      • The log will show you step by step details for how the steps that the code went through to evaluate your subscription, e.g. in the below trace you will find that it was evaluating the expression 
        "CoreFields/StringFields/Field[Name='Authorized As']/NewValue" <>'@@MyDisplayName@@'
        Which translated to 
        'a0aa2f1f-8a03-463f-9655-62563228acb9' <> 'a0aa2f1f-8a03-463f-9655-62563228acb9'
        So the evaluation failed
      • Calling matches for subscription 3 and Event 40
   EvaluateCondition: String to evaluate is "PortfolioProject" = 'test123' AND "CoreFields/StringFields/Field[Name='Created By']/NewValue" = '_@@MyDisplayName@@'         AND "CoreFields/StringFields/Field[Name='Authorized As']/NewValue" <> '_@@MyDisplayName@@'
   EvaluateCondition: Subscriber display name is a0aa2f1f-8a03-463f-9655-62563228acb9, Subscriber unique name is a0aa2f1f-8a03-463f-9655-62563228acb9
   EvaluateCondition: Condition references project with id: 63ffdcfc-cba4-47fd-be10-63c7efdc99a2 and name : test123
   StringFieldCondition.Evaluate: Begin evaluate Subscription 3, Event 40, Expression "CoreFields/StringFields/Field[Name='Created By']/NewValue" = '@@MyDisplayName@@'
   StringFieldCondition.Evaluate: Target Value = @@MyDisplayName@@
   FieldCondition.Evaluate: EvaluatedFieldName = CoreFields/StringFields/Field[Name='Created By']/NewValue
   StringFieldCondition.EvaluateOneValue: Value = a0aa2f1f-8a03-463f-9655-62563228acb9, Operator = 12, EvaluatedTarget = a0aa2f1f-8a03-463f-9655-62563228acb9
   StringFieldCondition.Evaluate: Begin evaluate Subscription 3, Event 40, Expression "CoreFields/StringFields/Field[Name='Authorized As']/NewValue" <>'@@MyDisplayName@@'
   StringFieldCondition.Evaluate: Target Value = @@MyDisplayName@@
   FieldCondition.Evaluate: EvaluatedFieldName = CoreFields/StringFields/Field[Name='Authorized As']/NewValue
   StringFieldCondition.EvaluateOneValue: Value = a0aa2f1f-8a03-463f-9655-62563228acb9, Operator = 13, EvaluatedTarget = a0aa2f1f-8a03-463f-9655-62563228acb9
   StringFieldCondition.Evaluate: Condition match was unsuccessful
   Condition match was False for event with id40 of type WorkItemChangedEvent
        Problem 2: Only a specific user is not receiving alerts - Again check the job results of any errors related to this user's email - Make sure the user is a member of the team - you can check by looking at the team membership page, the URL should look something like this: https://<server>:8080/tfs/DefaultCollection/<Project>/_admin/_security?_a=members If the user is not a member of the team they will not be receiving alerts Problem 3: There is a huge delay in Notifications - If you are not on Update 2.1 or Update 3 yet we highly recommend upgrading as a first step, lots of performance fixes were made in these two releases - Check out the job history to see where the time is being spent - run this on config DB 
        SELECT TOP 50
 DATEDIFF(ss, QueueTime, EndTime) TotalTime
,DATEDIFF(ss, QueueTime, StartTime) TimeSpentInQueue
,DATEDIFF(ss, StartTime, EndTime) ProcessingTime
,[JobSource]
,[JobId]
,[QueueTime]
,[StartTime]
,[EndTime]
,[AgentId]
,[Result]
,REPLACE(REPLACE([ResultMessage], CHAR(13), ), CHAR(10), ) 
,[QueuedReasons]
,[QueueFlags]
,[Priority]
FROM tbl_JobHistory WHERE JobId IN ( 'A4804DCF-4BB6-4109-B61C-E59C2E8A9FF7', -- event processing 'A96D6177-BEEF-477A-A2EE-2C31433214D0', -- email, soap, etc. delivery 'A0C22F34-652E-4B9C-A06B-3F4AFE4BE458' -- service hooks delivery ) ORDER BY 1 DESC
        - If too much time is spent in the Queue you might want to add more JobAgents or look at other jobs that are taking too long. - If too much time is spent in SOAP delivery you might want to fix your endpoint - If too much time is spent sending emails you might want to check the throttling settings on your mail server, as it can slow down the email delivery drastically.
    ]]>         Debugging error System.InvalidOperationException Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. https://docs.microsoft.com/archive/blogs/rihamselim/debugging-error-system-invalidoperationexception-timeout-expired-the-timeout-period-elapsed-prior-to-obtaining-a-connection-from-the-pool Tue, 24 Jun 2014 13:22:00 GMT https://blogs.msdn.microsoft.com/rihamselim/2014/06/24/debugging-error-system-invalidoperationexception-timeout-expired-the-timeout-period-elapsed-prior-to-obtaining-a-connection-from-the-pool/ Riham Selim Riham Selim 2 1572 2014-06-09T13:41:00Z 2014-06-09T13:41:00Z 4 4383 24984 Microsoft Corporation 208 58 29309 15.00

    Disclaimer: Most of the content for this post come from an amazing blog post by , which was the only source I could find on how to troubleshoot this issue, I am posting it here with some small modifications to fit a different scenario where we were not clear on which pool was having the leaking connections

    We started with several operations failing with this error

    CLR exception type: System.InvalidOperationException

        "Timeout expired.  The timeout period elapsed prior to obtaining a connection from the pool.  This may have occurred because all pooled connections were in use and max pool size was reached."

     The first step was to collect a memory dump, and start analyzing it, first we need to find all connection pools

    0:166> !Name2EE System.Data.dll System.Data.ProviderBase.DbConnectionPool

    Module:      00007ffbc78f4520

    Assembly:    System.Data.dll

    Token:       0000000002000229

    MethodTable: 00007ffbc8603f28

    EEClass:     00007ffbc85e7a88

    Name:        System.Data.ProviderBase.DbConnectionPool

     

    Then dump information about all connection pools using the MT we got from the previous step

    0:166> .foreach (foo {!DumpHeap -short -MT 00007ffbc8603f28}) {.echo foo; !do foo}

    0000003c7218fd38

    Name:        System.Data.ProviderBase.DbConnectionPool

    MethodTable: 00007ffbc8603f28

    EEClass:     00007ffbc85e7a88

    Size:        168(0xa8) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\System.Data\v4.0_4.0.0.0__b77a5c561934e089\System.Data.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    00007ffbc6d9f6f0  4000e73       80         System.Int32  1 instance           170000 _cleanupWait

    00007ffbc860bbb0  4000e74        8 ...ctionPoolIdentity  0 instance 0000003cf1fa4508 _identity

    00007ffbc8602b90  4000e75       10 ...ConnectionFactory  0 instance 0000003f71fcb8b0 _connectionFactory

    00007ffbc86025c8  4000e76       18 ...nnectionPoolGroup  0 instance 0000003c7218f780 _connectionPoolGroup

    00007ffbc860b500  4000e77       20 ...nPoolGroupOptions  0 instance 0000003c7218f758 _connectionPoolGroupOptions

    00007ffbc862e0f8  4000e78       28 ...nPoolProviderInfo  0 instance 0000000000000000 _connectionPoolProviderInfo

    00007ffbc8603dd0  4000e79       84         System.Int32  1 instance                1 _state

    00007ffbc862e188  4000e7a       30 ...al, System.Data]]  0 instance 0000003c7218fde0 _stackOld

    00007ffbc862e188  4000e7b       38 ...al, System.Data]]  0 instance 0000003c7218fe00 _stackNew

    00007ffbc862fb38  4000e7c       40 ...on, System.Data]]  0 instance 0000003c7218fe20 _pendingOpens

    00007ffbc6d9f6f0  4000e7d       88         System.Int32  1 instance                0 _pendingOpensWaiting

    00007ffbc6f0a188  4000e7e       48 ...ding.WaitCallback  0 instance 0000003c72190510 _poolCreateRequest

    00007ffbc6d9f6f0  4000e7f       8c         System.Int32  1 instance                0 _waitCount

    00007ffbc86504c0  4000e80       50 ...l+PoolWaitHandles  0 instance 0000003c7218ffe8 _waitHandles

    00007ffbc6de5290  4000e81       58     System.Exception  0 instance 0000003ff2c89558 _resError

    00007ffbc6d9c620  4000e82       9c       System.Boolean  1 instance                0 _errorOccurred

    00007ffbc6d9f6f0  4000e83       90         System.Int32  1 instance             5000 _errorWait

    00007ffbc7010048  4000e84       60 ...m.Threading.Timer  0 instance 0000000000000000 _errorTimer

    00007ffbc7010048  4000e85       68 ...m.Threading.Timer  0 instance 0000003c72190590 _cleanupTimer

    00007ffbc8650c98  4000e86       70 ...tedConnectionPool  0 instance 0000003c72190498 _transactedConnectionPool

    00007ffbc8650580  4000e87       78 ...al, System.Data]]  0 instance 0000003c72190130 _objectList

    00007ffbc6d9f6f0  4000e88       94         System.Int32  1 instance                4 _totalObjects

    00007ffbc6d9f6f0  4000e8a       98         System.Int32  1 instance                3 _objectID

    00007ffbc8304be8  4000e72      b98        System.Random  0   static 0000003cf1fa73c0 _random

    00007ffbc6d9f6f0  4000e89      a00         System.Int32  1   static             5117 _objectTypeCount

     The previous one does not seem interesting, since it has only 4 connections in the pool and the wait count is zero. Moving on to the next pool 

    0000003c7360fec8

    Name:        System.Data.ProviderBase.DbConnectionPool

    MethodTable: 00007ffbc8603f28

    EEClass:     00007ffbc85e7a88

    Size:        168(0xa8) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\System.Data\v4.0_4.0.0.0__b77a5c561934e089\System.Data.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    00007ffbc6d9f6f0  4000e73       80         System.Int32  1 instance           140000 _cleanupWait

    00007ffbc860bbb0  4000e74        8 ...ctionPoolIdentity  0 instance 0000003cf1fa4508 _identity

    00007ffbc8602b90  4000e75       10 ...ConnectionFactory  0 instance 0000003f71fcb8b0 _connectionFactory

    00007ffbc86025c8  4000e76       18 ...nnectionPoolGroup  0 instance 0000003f7215b290 _connectionPoolGroup

    00007ffbc860b500  4000e77       20 ...nPoolGroupOptions  0 instance 0000003f7215b268 _connectionPoolGroupOptions

    00007ffbc862e0f8  4000e78       28 ...nPoolProviderInfo  0 instance 0000000000000000 _connectionPoolProviderInfo

    00007ffbc8603dd0  4000e79       84         System.Int32  1 instance                1 _state

    00007ffbc862e188  4000e7a       30 ...al, System.Data]]  0 instance 0000003c7360ff70 _stackOld

    00007ffbc862e188  4000e7b       38 ...al, System.Data]]  0 instance 0000003c7360ff90 _stackNew

    00007ffbc862fb38  4000e7c       40 ...on, System.Data]]  0 instance 0000003c7360ffb0 _pendingOpens

    00007ffbc6d9f6f0  4000e7d       88         System.Int32  1 instance                0 _pendingOpensWaiting

    00007ffbc6f0a188  4000e7e       48 ...ding.WaitCallback  0 instance 0000003c736106a0 _poolCreateRequest

    00007ffbc6d9f6f0  4000e7f       8c         System.Int32  1 instance                2 _waitCount

    00007ffbc86504c0  4000e80       50 ...l+PoolWaitHandles  0 instance 0000003c73610178 _waitHandles

    00007ffbc6de5290  4000e81       58     System.Exception  0 instance 0000000000000000 _resError

    00007ffbc6d9c620  4000e82       9c       System.Boolean  1 instance                0 _errorOccurred

    00007ffbc6d9f6f0  4000e83       90         System.Int32  1 instance             5000 _errorWait

    00007ffbc7010048  4000e84       60 ...m.Threading.Timer  0 instance 0000000000000000 _errorTimer

    00007ffbc7010048  4000e85       68 ...m.Threading.Timer  0 instance 0000003c73610720 _cleanupTimer

    00007ffbc8650c98  4000e86       70 ...tedConnectionPool  0 instance 0000003c73610628 _transactedConnectionPool

    00007ffbc8650580  4000e87       78 ...al, System.Data]]  0 instance 0000003c736102c0 _objectList

    00007ffbc6d9f6f0  4000e88       94         System.Int32  1 instance              100 _totalObjects

    00007ffbc6d9f6f0  4000e8a       98         System.Int32  1 instance             3541 _objectID

    00007ffbc8304be8  4000e72      b98        System.Random  0   static 0000003cf1fa73c0 _random

    00007ffbc6d9f6f0  4000e89      a00         System.Int32  1   static             5117 _objectTypeCount

     This one definitely seems to be it, the number of connections in the pool is 100 which is our limit, and there are 2 objects waiting, so moving on to analyzing with more details based on Remi's instructions  

    0:166> !do 0000003c7360fec8

    Name:        System.Data.ProviderBase.DbConnectionPool

    MethodTable: 00007ffbc8603f28

    EEClass:     00007ffbc85e7a88

    Size:        168(0xa8) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\System.Data\v4.0_4.0.0.0__b77a5c561934e089\System.Data.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    00007ffbc6d9f6f0  4000e73       80         System.Int32  1 instance           140000 _cleanupWait

    00007ffbc860bbb0  4000e74        8 ...ctionPoolIdentity  0 instance 0000003cf1fa4508 _identity

    00007ffbc8602b90  4000e75       10 ...ConnectionFactory  0 instance 0000003f71fcb8b0 _connectionFactory

    00007ffbc86025c8  4000e76       18 ...nnectionPoolGroup  0 instance 0000003f7215b290 _connectionPoolGroup

    00007ffbc860b500  4000e77       20 ...nPoolGroupOptions  0 instance 0000003f7215b268 _connectionPoolGroupOptions

    00007ffbc862e0f8  4000e78       28 ...nPoolProviderInfo  0 instance 0000000000000000 _connectionPoolProviderInfo

    00007ffbc8603dd0  4000e79       84         System.Int32  1 instance                1 _state

    00007ffbc862e188  4000e7a       30 ...al, System.Data]]  0 instance 0000003c7360ff70 _stackOld

    00007ffbc862e188  4000e7b       38 ...al, System.Data]]  0 instance 0000003c7360ff90 _stackNew

    00007ffbc862fb38  4000e7c       40 ...on, System.Data]]  0 instance 0000003c7360ffb0 _pendingOpens

    00007ffbc6d9f6f0  4000e7d       88         System.Int32  1 instance                0 _pendingOpensWaiting

    00007ffbc6f0a188  4000e7e       48 ...ding.WaitCallback  0 instance 0000003c736106a0 _poolCreateRequest

    00007ffbc6d9f6f0  4000e7f       8c         System.Int32  1 instance                2 _waitCount

    00007ffbc86504c0  4000e80       50 ...l+PoolWaitHandles  0 instance 0000003c73610178 _waitHandles

    00007ffbc6de5290  4000e81       58     System.Exception  0 instance 0000000000000000 _resError

    00007ffbc6d9c620  4000e82       9c       System.Boolean  1 instance                0 _errorOccurred

    00007ffbc6d9f6f0  4000e83       90         System.Int32  1 instance             5000 _errorWait

    00007ffbc7010048  4000e84       60 ...m.Threading.Timer  0 instance 0000000000000000 _errorTimer

    00007ffbc7010048  4000e85       68 ...m.Threading.Timer  0 instance 0000003c73610720 _cleanupTimer

    00007ffbc8650c98  4000e86       70 ...tedConnectionPool  0 instance 0000003c73610628 _transactedConnectionPool

    00007ffbc8650580  4000e87       78 ...al, System.Data]]  0 instance 0000003c736102c0 _objectList  <-- This is the list of connections in this connection pool

    00007ffbc6d9f6f0  4000e88       94         System.Int32  1 instance              100 _totalObjects

    00007ffbc6d9f6f0  4000e8a       98         System.Int32  1 instance             3541 _objectID

    00007ffbc8304be8  4000e72      b98        System.Random  0   static 0000003cf1fa73c0 _random

    00007ffbc6d9f6f0  4000e89      a00         System.Int32  1   static             5117 _objectTypeCount

     Now we can inspect the objectlist

     0:166> !do 0000003c736102c0

    Name:        System.Collections.Generic.List`1[[System.Data.ProviderBase.DbConnectionInternal, System.Data]]

    MethodTable: 00007ffbc8650580

    EEClass:     00007ffbc6e423b8

    Size:        40(0x28) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\mscorlib\v4.0_4.0.0.0__b77a5c561934e089\mscorlib.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    00007ffbc6d9ba28  4000cd1        8      System.Object[]  0 instance 0000003c736102e8 _items  <-- Find the array of items

    00007ffbc6d9f6f0  4000cd2       18         System.Int32  1 instance              100 _size

    00007ffbc6d9f6f0  4000cd3       1c         System.Int32  1 instance             2126 _version

    00007ffbc6d96080  4000cd4       10        System.Object  0 instance 0000000000000000 _syncRoot

    00007ffbc6d9ba28  4000cd5        8      System.Object[]  0   static  <no information>

     Then Dump the contents of the array

     0:118> !da 0000003c736102e8

    Name:        System.Data.ProviderBase.DbConnectionInternal[]

    MethodTable: 00007ffbc6d9ba28

    EEClass:     00007ffbc6d9b980

    Size:        832(0x340) bytes

    Array:       Rank 1, Number of elements 100, Type CLASS

    Element Methodtable: 00007ffbc8602030

    [0] 0000003ff605c8b8

    [1] 0000003f7660b270

    [2] 0000003ef6d2e860

    [3] 0000003df7e341b0

    [4] 0000003ef73b3280

    [5] 0000003ef73b5260

    [6] 0000003f77ad5c20

    [7] 0000003e76deffb8

    [8] 0000003cf7894fc0

     ...

     Now You can start inspecting the different items in the array, to see if they all are being used by the same query using Remi's instructions

    0:118> !do 0000003ff605c8b8

    Name:        System.Data.SqlClient.SqlInternalConnectionTds

    MethodTable: 00007ffbc86289d8

    EEClass:     00007ffbc861d270

    Size:        304(0x130) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\System.Data\v4.0_4.0.0.0__b77a5c561934e089\System.Data.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    00007ffbc6d9f6f0  40008bb       38         System.Int32  1 instance            18391 _objectID

    00007ffbc6d9c620  40008be       44       System.Boolean  1 instance                0 _allowSetConnectionString

    00007ffbc6d9c620  40008bf       45       System.Boolean  1 instance                1 _hidePassword

    00007ffbc8601ed8  40008c0       3c         System.Int32  1 instance                1 _state

    00007ffbc6fca230  40008c1        8 System.WeakReference  0 instance 0000003ff605ca58 _owningObject

    00007ffbc8603f28  40008c2       10 ....DbConnectionPool  0 instance 0000003c7360fec8 _connectionPool

    00007ffbc8605050  40008c3       18 ...ctionPoolCounters  0 instance 0000003f71fcb8f0 _performanceCounters

    00007ffbc86816a0  40008c4       20 ...ferenceCollection  0 instance 0000003ff6061b38 _referenceCollection

    00007ffbc6d9f6f0  40008c5       40         System.Int32  1 instance                0 _pooledCount

    00007ffbc6d9c620  40008c6       46       System.Boolean  1 instance                0 _connectionIsDoomed

    00007ffbc6d9c620  40008c7       47       System.Boolean  1 instance                0 _cannotBePooled

    00007ffbc6d9c620  40008c8       48       System.Boolean  1 instance                0 _isInStasis

    00007ffbc6fce4f0  40008c9       50      System.DateTime  1 instance 0000003ff605c908 _createTime

    00007ffbc862e010  40008ca       28 ...tions.Transaction  0 instance 0000000000000000 _enlistedTransaction

    00007ffbc862e010  40008cb       30 ...tions.Transaction  0 instance 0000000000000000 _enlistedTransactionOriginal

    00007ffbc6d9f6f0  40008ba      700         System.Int32  1   static            18584 _objectTypeCount

    00007ffbc860b308  40008bc      628 ...teChangeEventArgs  0   static 0000003c71fb8d78 StateChangeClosed

    00007ffbc860b308  40008bd      630 ...teChangeEventArgs  0   static 0000003c71fb8d90 StateChangeOpen

    00007ffbc86019e8  400127f       58 ...lConnectionString  0 instance 0000003f7215acf8 _connectionOptions

    00007ffbc6d9c620  4001280       88       System.Boolean  1 instance                0 _isEnlistedInTransaction

    00007ffbc6e30eb0  4001281       60        System.Byte[]  0 instance 0000000000000000 _promotedDTCToken

    00007ffbc6e30eb0  4001282       68        System.Byte[]  0 instance 0000000000000000 _whereAbouts

    00007ffbc6de46f0  4001283       70        System.String  0 instance 0000003ff605da20 <CurrentDatabase>k__BackingField

    00007ffbc6de46f0  4001284       78        System.String  0 instance 0000003f7215ae18 <CurrentDataSource>k__BackingField

    00007ffbc884a318  4001285       80 ...egatedTransaction  0 instance 0000000000000000 <DelegatedTransaction>k__BackingField

    00007ffbc860d1b0  40012a7       90 ...GroupProviderInfo  0 instance 0000003f7215b2d8 _poolGroupProviderInfo

    00007ffbc8629c78  40012a8       98 ...lClient.TdsParser  0 instance 0000003ff605d4b8 _parser

    00007ffbc865e0e8  40012a9       a0 ...lient.SqlLoginAck  0 instance 0000003ff605daf0 _loginAck

    00007ffbc84cb330  40012aa       a8 ...ent.SqlCredential  0 instance 0000003cf2193680 _credential

    00007ffbc6d9c620  40012ab       89       System.Boolean  1 instance                1 _sessionRecoveryRequested

    00007ffbc6d9c620  40012ac       8a       System.Boolean  1 instance                1 _sessionRecoveryAcknowledged

    00007ffbc86558e0  40012ad       b0 ...lient.SessionData  0 instance 0000003ff605ca70 _currentSessionData

    00007ffbc86558e0  40012ae       b8 ...lient.SessionData  0 instance 0000000000000000 _recoverySessionData

    00007ffbc6d9c620  40012af       8b       System.Boolean  1 instance                1 _fConnectionOpen

    00007ffbc6d9c620  40012b0      110       System.Boolean  1 instance                1 _fResetConnection

    00007ffbc6de46f0  40012b1       c0        System.String  0 instance 0000003ff605da20 _originalDatabase

    00007ffbc6de46f0  40012b2       c8        System.String  0 instance 0000000000000000 _currentFailoverPartner

    00007ffbc6de46f0  40012b3       d0        System.String  0 instance 0000003ff605dac0 _originalLanguage

    00007ffbc6de46f0  40012b4       d8        System.String  0 instance 0000003ff605dac0 _currentLanguage

    00007ffbc6d9f6f0  40012b5       8c         System.Int32  1 instance             8000 _currentPacketSize

    00007ffbc6d9f6f0  40012b6      108         System.Int32  1 instance                0 _asyncCommandCount

    00007ffbc6de46f0  40012b7       e0        System.String  0 instance 0000003c71fa1450 _instanceName

    00007ffbc860bbb0  40012b8       e8 ...ctionPoolIdentity  0 instance 0000000000000000 _identity

    00007ffbc8656558  40012b9       f0 ...Tds+SyncAsyncLock  0 instance 0000003ff605c9e8 _parserLock

    00007ffbc6d9f6f0  40012ba      10c         System.Int32  1 instance               -1 _threadIdOwningParserLock

    00007ffbc8656970  40012bb       f8 ...eoutErrorInternal  0 instance 0000003ff605d3c8 timeoutErrorInternal

    00007ffbc6e3fb58  40012bc      118          System.Guid  1 instance 0000003ff605c9d0 _clientConnectionId

    00007ffbc8656ea0  40012bd      100 ...lient.RoutingInfo  0 instance 0000000000000000 _routingInfo

     Now Dump the _parser member

     0:118> !do 0000003ff605d4b8

    Name:        System.Data.SqlClient.TdsParser

    MethodTable: 00007ffbc8629c78

    EEClass:     00007ffbc861d2f8

    Size:        160(0xa0) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\System.Data\v4.0_4.0.0.0__b77a5c561934e089\System.Data.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    00007ffbc6d9f6f0  400151a       70         System.Int32  1 instance            18394 _objectID

    00007ffbc862b328  400151c        8 ...ParserStateObject  0 instance 0000003ff605d558 _physicalStateObj

    00007ffbc862b328  400151d       10 ...ParserStateObject  0 instance 0000000000000000 _pMarsPhysicalConObj

    00007ffbc86299d0  400151e       74         System.Int32  1 instance                2 _state

    00007ffbc6de46f0  400151f       18        System.String  0 instance 0000003f7215ae18 _server

    00007ffbc6d9c620  4001520       88       System.Boolean  1 instance                0 _fResetConnection

    00007ffbc6d9c620  4001521       89       System.Boolean  1 instance                0 _fPreserveTransaction

    00007ffbc865d050  4001522       20 ...ient.SqlCollation  0 instance 0000003ff605daa8 _defaultCollation

    00007ffbc6d9f6f0  4001523       78         System.Int32  1 instance             1252 _defaultCodePage

    00007ffbc6d9f6f0  4001524       7c         System.Int32  1 instance             1033 _defaultLCID

    00007ffbc7018568  4001525       28 System.Text.Encoding  0 instance 0000003c71fc23b0 _defaultEncoding

    00007ffbc8629b20  4001527       80         System.Int32  1 instance                1 _encryptionOption

    00007ffbc860ef98  4001528       30 ...ternalTransaction  0 instance 0000000000000000 _currentTransaction

    00007ffbc860ef98  4001529       38 ...ternalTransaction  0 instance 0000000000000000 _pendingTransaction

    00007ffbc6de0630  400152a       68         System.Int64  1 instance 0 _retainedTransactionId

    00007ffbc6d9f6f0  400152b       84         System.Int32  1 instance                1 _nonTransactedOpenResultCount

    00007ffbc86289d8  400152c       40 ...rnalConnectionTds  0 instance 0000003ff605c8b8 _connHandler

    00007ffbc6d9c620  400152d       8a       System.Boolean  1 instance                0 _fMARS

    00007ffbc6d9c620  400152e       8b       System.Boolean  1 instance                0 _loginWithFailover

    00007ffbc73f0698  400152f       48 ...ng.AutoResetEvent  0 instance 0000000000000000 _resetConnectionEvent

    00007ffbc862b4e8  4001530       50 ...ParserSessionPool  0 instance 0000000000000000 _sessionPool

    00007ffbc6d9c620  4001531       8c       System.Boolean  1 instance                1 _isShiloh

    00007ffbc6d9c620  4001532       8d       System.Boolean  1 instance                1 _isShilohSP1

    00007ffbc6d9c620  4001533       8e       System.Boolean  1 instance                1 _isYukon

    00007ffbc6d9c620  4001534       8f       System.Boolean  1 instance                1 _isKatmai

    00007ffbc6d9c620  4001535       90       System.Boolean  1 instance                1 _isDenali

    00007ffbc6e30eb0  4001536       58        System.Byte[]  0 instance 0000000000000000 _sniSpnBuffer

    00007ffbc86281b0  4001537       60 ...ent.SqlStatistics  0 instance 0000000000000000 _statistics

    00007ffbc6d9c620  4001538       91       System.Boolean  1 instance                0 _statisticsIsInTransaction

    00007ffbc6d9c620  400153f       92       System.Boolean  1 instance                0 _asyncWrite

    00007ffbc6d9f6f0  4001519      a60         System.Int32  1   static            18587 _objectTypeCount

    00007ffbc6f0b5d0  400151b     1130 ...eading.Tasks.Task  0   static 0000000000000000 completedTask

    00007ffbc8629b20  4001526      a64         System.Int32  1   static                0 _sniSupportedEncryptionOption

    00007ffbc6e30eb0  4001539     1138        System.Byte[]  0   static 0000003c71fbec48 s_nicAddress

    00007ffbc6d9c620  400153a      a6c       System.Boolean  1   static                0 s_fSSPILoaded

    00007ffbc6d9fe78  400153b      a68        System.UInt32  1   static                0 s_maxSSPILength

    00007ffbc6e30eb0  400153c     1140        System.Byte[]  0   static 0000003cf1fc24d0 s_longDataHeader

    00007ffbc6d96080  400153d     1148        System.Object  0   static 0000003cf1fc2508 s_tdsParserLock

    00007ffbc6e30eb0  400153e     1150        System.Byte[]  0   static 0000003cf1fc2520 s_xmlMetadataSubstituteSequence

    00007ffbc86575c8  4001540     1158 ...rd, System.Data]]  0   static 0000003cf1fc2588 __tvpEmptyValue

     Then dump the _physicalStateObj

     0:118> !do 0000003ff605d558

    Name:        System.Data.SqlClient.TdsParserStateObject

    MethodTable: 00007ffbc862b328

    EEClass:     00007ffbc861d750

    Size:        440(0x1b8) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\System.Data\v4.0_4.0.0.0__b77a5c561934e089\System.Data.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    00007ffbc6d9f6f0  40015ea      130         System.Int32  1 instance            18394 _objectID

    00007ffbc8629c78  40015eb        8 ...lClient.TdsParser  0 instance 0000003ff605d4b8 _parser

    00007ffbc862a388  40015ec       10 ...lClient.SNIHandle  0 instance 0000003ff605d8b8 _sessionHandle

    00007ffbc6fca230  40015ed       18 System.WeakReference  0 instance 0000003ff605d710 _owner

    00007ffbc8682960  40015ee       20 ...eader+SharedState  0 instance 0000003c77292e50 _readerState

    00007ffbc6d9f6f0  40015ef      134         System.Int32  1 instance                0 _activateCount

    00007ffbc6d9f6f0  40015f0      138         System.Int32  1 instance                8 _inputHeaderLen

    00007ffbc6d9f6f0  40015f1      13c         System.Int32  1 instance                8 _outputHeaderLen

    00007ffbc6e30eb0  40015f2       28        System.Byte[]  0 instance 0000003ff605fab8 _outBuff

    00007ffbc6d9f6f0  40015f3      140         System.Int32  1 instance                8 _outBytesUsed

    00007ffbc6e30eb0  40015f4       30        System.Byte[]  0 instance 0000003ff605db60 _inBuff

    00007ffbc6d9f6f0  40015f5      144         System.Int32  1 instance             7823 _inBytesUsed

    00007ffbc6d9f6f0  40015f6      148         System.Int32  1 instance             7841 _inBytesRead

    00007ffbc6d9f6f0  40015f7      14c         System.Int32  1 instance               18 _inBytesPacket

    00007ffbc6d9e008  40015f8      17c          System.Byte  1 instance                3 _outputMessageType

    00007ffbc6d9e008  40015f9      17d          System.Byte  1 instance                1 _messageStatus

    00007ffbc6d9e008  40015fa      17e          System.Byte  1 instance                1 _outputPacketNumber

    00007ffbc6d9c620  40015fb      17f       System.Boolean  1 instance                1 _pendingData

    00007ffbc6d9c620  40015fc      180       System.Boolean  1 instance                0 _fResetEventOwned

    00007ffbc6d9c620  40015fd      181       System.Boolean  1 instance                0 _fResetConnectionSent

    00007ffbc6d9c620  40015fe      182       System.Boolean  1 instance                0 _errorTokenReceived

    00007ffbc6d9c620  40015ff      183       System.Boolean  1 instance                0 _bulkCopyOpperationInProgress

    00007ffbc6d9c620  4001600      184       System.Boolean  1 instance                0 _bulkCopyWriteTimeout

    00007ffbc86595d8  4001601       38 ...lClient.SNIPacket  0 instance 0000003ff6061b18 _sniPacket

    00007ffbc86595d8  4001602       40 ...lClient.SNIPacket  0 instance 0000003f76cc7ae8 _sniAsyncAttnPacket

    00007ffbc8659500  4001603       48 ....WritePacketCache  0 instance 0000003ff605d728 _writePacketCache

    00007ffbc8659698  4001604       50 ...et, System.Data]]  0 instance 0000003ff605d770 _pendingWritePackets

    00007ffbc6d96080  4001605       58        System.Object  0 instance 0000003ff605d7c0 _writePacketLockObject

    00007ffbc6f9cf88  4001606      198 ...Services.GCHandle  1 instance 0000003ff605d6f0 _gcHandle

    00007ffbc6d9f6f0  4001607      150         System.Int32  1 instance                1 _pendingCallbacks

    00007ffbc6de0630  4001608      110         System.Int64  1 instance 3600000 _timeoutMilliseconds

    00007ffbc6de0630  4001609      118         System.Int64  1 instance 0 _timeoutTime

    00007ffbc6d9c620  400160a      185       System.Boolean  1 instance                0 _attentionSent

    00007ffbc6d9c620  400160b      186       System.Boolean  1 instance                0 _attentionReceived

    00007ffbc6d9c620  400160c      187       System.Boolean  1 instance                0 _attentionSending

    00007ffbc6d9c620  400160d      188       System.Boolean  1 instance                0 _internalTimeout

    00007ffbc8659f30  400160e       60 ...lient.LastIOTimer  0 instance 0000003ff605d860 _lastSuccessfulIOTimer

    00007ffbc6d9ba28  400160f       68      System.Object[]  0 instance 0000003ff605d7d8 _securePasswords

    00007ffbc6f08e38  4001610       70       System.Int32[]  0 instance 0000003ff605d808 _securePasswordOffsetsInBuffer

    00007ffbc6d9c620  4001611      189       System.Boolean  1 instance                0 _cancelled

    00007ffbc6d9f6f0  4001612      154         System.Int32  1 instance         12664123 _allowObjectID

    00007ffbc6d9c620  4001613      18a       System.Boolean  1 instance                1 _hasOpenResult

    00007ffbc860ef98  4001614       78 ...ternalTransaction  0 instance 0000000000000000 _executedUnderTransaction

    00007ffbc6de0db8  4001615      120        System.UInt64  1 instance 0 _longlen

    00007ffbc6de0db8  4001616      128        System.UInt64  1 instance 0 _longlenleft

    00007ffbc6f08e38  4001617       80       System.Int32[]  0 instance 0000000000000000 _decimalBits

    00007ffbc6e30eb0  4001618       88        System.Byte[]  0 instance 0000003c7570fa38 _bTmp

    00007ffbc6d9f6f0  4001619      158         System.Int32  1 instance                0 _bTmpRead

    00007ffbc702fe68  400161a       90  System.Text.Decoder  0 instance 0000000000000000 _plpdecoder

    00007ffbc6d9c620  400161b      18b       System.Boolean  1 instance                0 _accumulateInfoEvents

    00007ffbc865e328  400161c       98 ...or, System.Data]]  0 instance 0000000000000000 _pendingInfoEvents

    00007ffbc6e30eb0  400161d       a0        System.Byte[]  0 instance 0000003ff605d828 _partialHeaderBuffer

    00007ffbc6d9f6f0  400161e      15c         System.Int32  1 instance                0 _partialHeaderBytesRead

    00007ffbc860f2b0  400161f       a8 ...t._SqlMetaDataSet  0 instance 0000003c77298240 _cleanupMetaData

    00007ffbc865ead8  4001620       b0 ...DataSetCollection  0 instance 0000000000000000 _cleanupAltMetaDataSetArray

    00007ffbc6d9f6f0  4001621      160         System.Int32  1 instance              208 _tracePasswordOffset

    00007ffbc6d9f6f0  4001622      164         System.Int32  1 instance              144 _tracePasswordLength

    00007ffbc6d9f6f0  4001623      168         System.Int32  1 instance              648 _traceChangePasswordOffset

    00007ffbc6d9f6f0  4001624      16c         System.Int32  1 instance                0 _traceChangePasswordLength

    00007ffbc6d9c620  4001625      18c       System.Boolean  1 instance                0 _receivedColMetaData

    00007ffbc862b0a0  4001626      170         System.Int32  1 instance               11 _sniContext

    00007ffbc6d9c620  4001627      18d       System.Boolean  1 instance                0 _bcpLock

    00007ffbc862b288  4001628      1a0 ...Object+NullBitmap  1 instance 0000003ff605d6f8 _nullBitmapInfo

    00007ffbc8574750  4001629       b8 ...bject, mscorlib]]  0 instance 0000000000000000 _networkPacketTaskSource

    00007ffbc7010048  400162a       c0 ...m.Threading.Timer  0 instance 0000000000000000 _networkPacketTimeout

    00007ffbc6d9c620  400162b      18e       System.Boolean  1 instance                1 _syncOverAsync

    00007ffbc6d9c620  400162c      18f       System.Boolean  1 instance                0 _snapshotReplay

    00007ffbc865c0b0  400162d       c8 ...ect+StateSnapshot  0 instance 0000000000000000 _snapshot

    00007ffbc70106c0  400162e       d0 ....ExecutionContext  0 instance 0000000000000000 _executionContext

    00007ffbc6d9c620  400162f      190       System.Boolean  1 instance                0 _asyncReadWithoutSnapshot

    00007ffbc860cb40  4001630       d8 ...qlErrorCollection  0 instance 0000000000000000 _errors

    00007ffbc860cb40  4001631       e0 ...qlErrorCollection  0 instance 0000000000000000 _warnings

    00007ffbc6d96080  4001632       e8        System.Object  0 instance 0000003ff605d848 _errorAndWarningsLock

    00007ffbc6d9c620  4001633      191       System.Boolean  1 instance                0 _hasErrorOrWarning

    00007ffbc860cb40  4001634       f0 ...qlErrorCollection  0 instance 0000000000000000 _preAttentionErrors

    00007ffbc860cb40  4001635       f8 ...qlErrorCollection  0 instance 0000000000000000 _preAttentionWarnings

    00007ffbc8574750  4001636      100 ...bject, mscorlib]]  0 instance 0000000000000000 _writeCompletionSource

    00007ffbc6d9f6f0  4001637      174         System.Int32  1 instance                0 _asyncWriteCount

    00007ffbc6de5290  4001638      108     System.Exception  0 instance 0000000000000000 _delayedWriteAsyncCallbackException

    00007ffbc6d9f6f0  4001639      178         System.Int32  1 instance                0 _readingCount

    00007ffbc6d9f6f0  40015e9      a74         System.Int32  1   static            18587 _objectTypeCount

     

    And Finally the _outbuff, which has the actual sproc name

     0:118> !do 0000003ff605fab8

    Name:        System.Byte[]

    MethodTable: 00007ffbc6e30eb0

    EEClass:     00007ffbc6e30e20

    Size:        8024(0x1f58) bytes

    Array:       Rank 1, Number of elements 8000, Type Byte

    Content:     ...S............................p.r.c._.Q.u.e.r.y.B.u.i.l.d.s.B.y.U.r.i....@.p.a.r.t.i.t.i.o.n.I.d..&...>...@.b.u.i.l.d.U.r.i.T.

    Fields:

    Now that you know which sproc call is leaking you can start inspecting the code to see who is making these calls, also, if you are lucky enough you might be able to find the stack trace causing the leak!

     

    ]]>         .Net contention scenario using PerfView https://docs.microsoft.com/archive/blogs/rihamselim/net-contention-scenario-using-perfview Mon, 24 Feb 2014 21:25:00 GMT https://blogs.msdn.microsoft.com/rihamselim/2014/02/24/net-contention-scenario-using-perfview/ This is a contention case study from one of our ATs - I have been learning a lot about PerfView from one of our more experienced devs, once you get a grip of it, you can do amazing things with perfview.

    The perfview was collected using this command (which tells it to collect a perfview once contention CPU exceeds 90%

    perfview collect /merge /zip /AcceptEULA "/StopOnPerfCounter=Processor:% Processor Time:_Total>90" /nogui /NoNGenRundown /DelayAfterTriggerSec=30

    Once perfview was collected, we followed these steps:

    1-     Open etl file with perf view

    2-     Double click on CPU stacks

    3-     Select the process you want to investigate (w3wp, waworkerhost,…)

     

     

    4-     Clear Fold% and enter, then select all and choose Lookup Symbols

    5-     Search for clr!JITutil_MonContention – look for the inclusive % - in this case it is 45% which means there is a significant amount of contention going on

     

     

     

    6-     Double click on this row, it will show you the stacks where contention is happening -

     

     

    7-     To Dig deeper use the below steps to get additional details on what the threads were doing at the time of the contention.

    8-     Go back to PerfView main window, double click on ASP.Net stats

    9-     Pick the interval with highest contention, in this case they are all just as bad, so we picked (19,000 to 20,000)

                             

     

    10-  Go back to PerfView main window

    11-  Double click on events

    12-  Filter by contention events (see screenshot) and press enter to refresh.

    13-  Filter by the start and end of the interval you got in step 9

    14-  Double click on Columns to Display and Choose ThreadID, then sort data by Thread ID

     

    15-  Pick the thread with the most contention events (e.g. 3232)

    16-  Select the row

    17-  Press ALT + S (or right click and choose Open any stacks) – this will set the time filter for you to 19000 - 20000

    18-  Search for the thread ID you are interested in

    19-  Select the row containing the thread and Press ALT + I  (isolate)

    20-  You will see all the stacks for this thread at the time where it had the issue

     

    Now you know exactly when the contention happened, how much CPU it was using, which threads caused most contention, and what exactly your threads were doing right before the contention.

    ]]>         Introduction to PerfView https://docs.microsoft.com/archive/blogs/rihamselim/introduction-to-perfview Mon, 24 Feb 2014 21:18:33 GMT https://blogs.msdn.microsoft.com/rihamselim/2014/02/24/introduction-to-perfview/ Perf view is our new favorite debugging tool, I very highly recommend watching the video series provided by PerfView creator Vance Morrison at https://channel9.msdn.com/Series/PerfView-Tutorial

    I will start blogging a little bit about several interesting scenarios that can be debugged using perf view - check the next few posts!

    ]]>         Which performance counters to monitor on an azure role? https://docs.microsoft.com/archive/blogs/rihamselim/which-performance-counters-to-monitor-on-an-azure-role Mon, 09 Dec 2013 13:57:00 GMT https://blogs.msdn.microsoft.com/rihamselim/2013/12/09/which-performance-counters-to-monitor-on-an-azure-role/ One of the first questions we asked when visual studio online (which was still tfspreview.com back then) was released was which performance counters should we be watching? How can we tell that something is wrong?

    Now almost 4 years later we know a lot more about things that can go wrong and affect the service, but the list is still growing, for now I wanted to share some of the things we learned to watch for through experience, for many of these I am using the default thresholds recommended here for web roles specific counters.
    I also suggest reading ASP.NET Performance, Troubleshooting, and Debugging

    Process and machine health

    The alert threshold for all these performance counters is very application specific, you will be able to tell what is ok and what is not by watching patterns over normal and peak hours.

    • Process(w3wp)\Private Bytes
    • Process(w3wp)\Virtual Bytes
    • Process(w3wp)\Thread Count
    • Process(w3wp)\Handle Count
    • TCPv4\Connections Established"
    • Processor(_Total)\% Processor Time
    • Memory\Available Mbytes

    Contentions

    Again these are application specific, you want to have as little contention as possible, ideally zero, but that’s not always feasible

    • .NET CLR LocksAndThreads(_Global_)\Current Queue Length
    • .NET CLR LocksAndThreads(_Global_)\Contention Rate / sec

    Disk Performance

    We learned this one the hard way, when things go wrong with your service, looking at disk usage isn’t the first thing that comes to your mind, particularly if you haven’t seen an increase in activity or disk usage, remember that in the cloud you do not own the machines, so you can have different hardware every time, with a new set of challenges  

    •  LogicalDisk(*)\% Free Space
    •  PhysicalDisk(*)\Avg. Disk Queue Length
    •  PhysicalDisk(*)\Avg. Disk sec/Read
    •  PhysicalDisk(*)\Avg. Disk sec/Transfer
    •  PhysicalDisk(*)\Avg. Disk sec/Write
    •  PhysicalDisk(*)\Disk Reads/sec
    •  PhysicalDisk(*)\Disk Transfers/sec
    •  PhysicalDisk(*)\Disk Writes/sec
    •  LogicalDisk(*)\Avg. Disk sec/Transfer
    •  LogicalDisk(*)\Disk Bytes/sec
    •  LogicalDisk(*)\Disk Transfers/sec

    Network Usage

    If you have lots of dependencies, you will probably want to add custom counters for traffic to each of these dependencies

    •  Network Interface(*)\Bytes Received/sec
    •  Network Interface(*)\Bytes Sent/sec

    For obvious reasons, it is never a good sign if you find this falling to zero frequently :)

    • System\System Up Time

    ASP.Net Counters

    This is the first thing we look at when we have a performance problem, these are very well documented in the MSDN article ASP.NET Performance Monitoring, and When to Alert Administrators

    • ASP.NET Applications(__Total__)\Requests/Sec
    • ASP.NET Applications(__Total__)\Requests Executing
    • ASP.NET Applications(__Total__)\Request Wait Time
    • ASP.NET Applications(__Total__)\Request Execution Time
    • ASP.NET Applications(__Total__)\Requests In Application Queue
    • ASP.NET\Application Restarts
    • ASP.NET\Requests Rejected
    • ASP.NET\Worker Process Restarts

    SQL connections and activity if you are using SQL:

    If ReclaimedConnections is anything greater than zero, alert! Someone is leaking connections!

    • .NET Data Provider for SqlServer(*)\NumberOfPooledConnections
    • .NET Data Provider for SqlServer(*)\NumberOfReclaimedConnections
    • .NET Data Provider for SqlServer(*)\NumberOfActiveConnectionPools

    CLR (you might need more or less counters depending on your service)

    • .NET CLR Exceptions(*)\# of Exceps Thrown / sec
    • .NET CLR Memory(_Global_)\# Bytes in all Heaps
    • .NET CLR Memory(_Global_)\% Time in GC
    • .NET CLR Memory(_Global_)\Allocated Bytes/sec

    Web Service

    • Web Service\Current Connections
    • Web Service\ISAPI Extension Requests/sec

     

    We have a lot more perf counters that are application specific, I would love to hear your thoughts and experiences about things that broke when you were not watching the right counters!

    ]]>         Dumping the contents of a dictionary object using Windbg and SOS.dll https://docs.microsoft.com/archive/blogs/rihamselim/dumping-the-contents-of-a-dictionary-object-using-windbg-and-sos-dll Fri, 16 Aug 2013 10:07:00 GMT https://blogs.msdn.microsoft.com/rihamselim/2013/08/16/dumping-the-contents-of-a-dictionary-object-using-windbg-and-sos-dll/ Riham Selim Riham Selim 1 13 2013-08-16T16:48:00Z 2013-08-16T17:01:00Z 2 729 4156 Microsoft Corporation 34 9 4876 14.00

    In order to dump the contents of a dictionary, you need to start with either the MethodTable or the name of the class, then you can follow the below steps: 

    0:009> !dumpheap -mt 000007feeed0b9c0

             Address               MT     Size

    000000018003e630 000007feeed0b9c0       80    

    000000018008ec10 000007feeed0b9c0       80     

    Statistics:

                  MT    Count    TotalSize Class Name

    000007feeed0b9c0        2          160 System.Collections.Generic.Dictionary`2[[System.Guid, mscorlib],[Microsoft.TeamFoundation.Framework.Server.TeamFoundationPerformanceCounters, Microsoft.TeamFoundation.Framework.Server]]

    Total 2 objects

    Note: You can also use -Dumpheap -type System.Collections.Generic.Dictionary`2[[System.Guid, mscorlib],[Microsoft.TeamFoundation.Framework.Server.TeamFoundationPerformanceCounters,Microsoft.TeamFoundation.Framework.Server]]

     

    0:009> !do 000000018003e630

    Name:        System.Collections.Generic.Dictionary`2[[System.Guid, mscorlib],[Microsoft.TeamFoundation.Framework.Server.TeamFoundationPerformanceCounters, Microsoft.TeamFoundation.Framework.Server]]

    MethodTable: 000007feeed0b9c0

    EEClass:     000007fef6368220

    Size:        80(0x50) bytes

    File:        C:\Windows\Microsoft.Net\assembly\GAC_64\mscorlib\v4.0_4.0.0.0__b77a5c561934e089\mscorlib.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    000007fef69516e8  4000c5a        8       System.Int32[]  0 instance 000000018003ea90 buckets

    000007fef74448a8  4000c5b       10 ...non, mscorlib]][]  0 instance 000000018003eac8 entries

    000007fef6951748  4000c5c       38         System.Int32  1 instance                7 count

    000007fef6951748  4000c5d       3c         System.Int32  1 instance                7 version

    000007fef6951748  4000c5e       40         System.Int32  1 instance               -1 freeList

    000007fef6951748  4000c5f       44         System.Int32  1 instance                0 freeCount

    000007fef698f1a8  4000c60       18 ....Guid, mscorlib]]  0 instance 000000038000dc90 comparer

    000007fef74bfd40  4000c61       20 ...Canon, mscorlib]]  0 instance 0000000000000000 keys

    000007fef74bd380  4000c62       28 ...Canon, mscorlib]]  0 instance 000000018206b690 values

    000007fef694ef78  4000c63       30        System.Object  0 instance 0000000000000000 _syncRoot

    0:009> !da 000000018003eac8

    Name:        System.Collections.Generic.Dictionary`2+Entry[[System.Guid, mscorlib],[Microsoft.TeamFoundation.Framework.Server.TeamFoundationPerformanceCounters, Microsoft.TeamFoundation.Framework.Server]][]

    MethodTable: 000007fe984b5918

    EEClass:     000007fe984b5870

    Size:        248(0xf8) bytes

    Array:       Rank 1, Number of elements 7, Type VALUETYPE

    Element Methodtable: 000007fe984b57d8

    [0] 000000018003ead8

    [1] 000000018003eaf8

    [2] 000000018003eb18

    [3] 000000018003eb38

    [4] 000000018003eb58

    [5] 000000018003eb78

    [6] 000000018003eb98

    0:009> !dumpvc 000007fe984b57d8 000000018003ead8

    Name:        System.Collections.Generic.Dictionary`2+Entry[[System.Guid, mscorlib],[Microsoft.TeamFoundation.Framework.Server.TeamFoundationPerformanceCounters, Microsoft.TeamFoundation.Framework.Server]]

    MethodTable: 000007fe984b57d8

    EEClass:     000007fef6368348

    Size:        48(0x30) bytes

    File:        C:\Windows\Microsoft.Net\assembly\GAC_64\mscorlib\v4.0_4.0.0.0__b77a5c561934e089\mscorlib.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    000007fef6951748  4000c68        8         System.Int32  1 instance       1348927451 hashCode

    000007fef6951748  4000c69        c         System.Int32  1 instance               -1 next

    000007fef69497e0  4000c6a       10          System.Guid  1 instance 000000018003eae8 key

    000007fef6953be8  4000c6b        0       System.__Canon  0 instance 000000018003e890 value

     

    0:009> !do 000000018003e890

    Name:        Microsoft.TeamFoundation.Framework.Server.TeamFoundationPerformanceCounters

    MethodTable: 000007feef604a38

    EEClass:     000007feeed727e8

    Size:        64(0x40) bytes

    File:        C:\Program Files\Microsoft Team Foundation Server 12.0\Application Tier\TfsJobAgent\Microsoft.TeamFoundation.Framework.Server.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    000007fef6955a00  4000ec4        8 ....ReaderWriterLock  0 instance 000000018003e8d0 m_serializationObject

    000007fef694e998  4000ec5       10        System.String  0 instance 0000000000000000 m_counterCategoryName

    000007fef4c6e4d0  4000ec6       18 ...ounterSetInstance  0 instance 0000000000000000 m_defaultCounterSetInstance

    000007feeecb7a58  4000ec7       20 ...ramework.Server]]  0 instance 0000000000000000 m_counterSetInstances

    000007fef4c6e430  4000ec8       28 ...ceData.CounterSet  0 instance 0000000000000000 m_counterSet

    000007fef6932398  4000ec9       30      System.Object[]  0 instance 0000000000000000 m_counters

     

    ]]>         Resolving CREATE DATABASE permission denied in database [db] when running Create Database [BKUP] as copy of [DB] in SQL Azure https://docs.microsoft.com/archive/blogs/rihamselim/resolving-create-database-permission-denied-in-database-db-when-running-create-database-bkup-as-copy-of-db-in-sql-azure Thu, 13 Jun 2013 11:37:00 GMT https://blogs.msdn.microsoft.com/rihamselim/2013/06/13/resolving-create-database-permission-denied-in-database-db-when-running-create-database-bkup-as-copy-of-db-in-sql-azure/ The easiest way to back up databases in SQL Azure is to run Create Database [BKUP] as copy of [DB] command, but this often fails with error

    CREATE DATABASE permission denied in database 'DB'

    What this error really means is that you do not have permissions to perform this operation, this is how to resolve the problem

    1- Find the user with the right set of permissions by running the following command - and chosing the user associated with the database you are trying to copy

    select d.name, l.name from sys.sysdatabases as d
    left join sys.sql_logins as l
    on d.sid = l.sid

    2- Connect as this specific user and try to run the command, it should work

    3- In some rare cases, the user gets deleted by mistake, so you see the user as NULL from the previous query, in this case you can create a new user with the same SID

    Run the following query in master:

    SELECT [name], [sid]
    FROM [sys].[sql_logins]
    WHERE [type_desc] = 'SQL_Login'

    Run the following query in the database [db]:

    SELECT [name], [sid]
    FROM
    [sys].[database_principals]
    WHERE [type_desc] = 'SQL_USER'

    4- Get the user SID from the previous query, now you can create a new user using the same SID

    CREATE LOGIN [<login>]
    WITH PASSWORD = ‘<password’, SID =0x010600000000006480000000000002A83C9BDF82B8E22220AC07FA6A02474304 <-- This is the SID you got from the previous step

    5- Now you can connect as this user and run your Copy command

    You can monitor the progress using this query
    select name, state,state_desc from sys.databases where name = 'BKUP'

    ]]>         How to convert pretty much any 2D image to a 3D object in OpenSCAD format https://docs.microsoft.com/archive/blogs/rihamselim/how-to-convert-pretty-much-any-2d-image-to-a-3d-object-in-openscad-format Sat, 08 Jun 2013 07:50:00 GMT https://blogs.msdn.microsoft.com/rihamselim/2013/06/08/how-to-convert-pretty-much-any-2d-image-to-a-3d-object-in-openscad-format/ I have recently become quite obsessed with 3D design and printing, thanks to OpenSCAD that made designing 3D objects just too easy not to try, if you want to make 3D models from an image or SVG file, you can do it very easily - there are other ways to convert to other 3D formats, so this is only if you want to use SCAD

     

    Why SCAD?

     

    SCAD is very good for programmers we aren't as good with Interactive 3D design like myself, while I find it really hard to arrange my objects right with interactive 3D software , it is so much easier for me to manipulate the numbers in OpenSCAD to get the results I want.

    Because it is just a script, you can create objects and upload them to thingiverse to use them with makerbot customizer, customizer is a way to parametrize any SCAD file which makes it very easy for even people who don't know how to create 3D models - check the customizable things on thingiverse to get some ideas.

     

    So now to the actual steps, if you already have an svg file you can skip step 2.

     

    Step 1- Download your tools

    1- Download Inkscape from https://inkscape.org/download/

    2- Download OpenScad from https://www.openscad.org/

    3- Download the InkScape to OpenSCAD converter from https://www.thingiverse.com/thing:24808 - Follow the instructions to install the extension to InkScape

     

     

     

    Step 2- Convert image to SVG

    1- Pick an image and open the image with InkScape
    2- Convert the image to path by selecting Trace Bitmap from the Path menu

     

    3- Play around with the settings until you get the result you want, if you choose Edge Detection you can actually get a hollow 3D object, in this case I am looking for a solid object, so I picked these settings:

    Now you can delete the image and keep the path you just created 

    '

     

     

    Step 3- Convert SVG to SCAD

     

    Now you are ready to open your file with OpenSCAD

     

     


     Step 4- Print your object

    There are lots of places where you can print a 3D object now, for beginners, you can try Ponoko or https://www.shapeways.com, I haven't tried either one to give good feedback :)

    Enjoy!

    ]]>         My SOS cheat sheet https://docs.microsoft.com/archive/blogs/rihamselim/my-sos-cheat-sheet Mon, 11 Feb 2013 07:18:00 GMT https://blogs.msdn.microsoft.com/rihamselim/2013/02/11/my-sos-cheat-sheet/ Riham Selim Blog.dotx Riham Selim 6 40155 2013-02-07T21:12:00Z 2013-02-11T16:00:00Z 1 870 4964 Microsoft Corporation 41 11 5823 14.00

     There are some handy sos commands that I need to use frequently while debugging, there are several other handy sos cheat sheets available that I use as well, check this one for example. 

    Breaking and Breakpoints

      

    Print all CLR exceptions and continue execution


    sxe -c "!pe;g" clr

    You can run .logopen “C:\MyErrors.log” before this command and .LogClose after it so all you errors will be logged to the file

     

    Break on specific exception type

    !soe -Create System.Data.SqlClient.SqlException

    Place a breakpoint

    Check this link for more details.

    !Name2EE Microsoft_TeamFoundation_Framework_Server!Microsoft.TeamFoundation.Framework.Server.TeamFoundationApplication

    !DumpMT -MD 000007ff0030fe28

    !bpmd -md 000007ff0030fd50

    Conditional breakpoint

    bp Address ".if (Condition) {OptionalCommands} .else {gc}"

     

    Dumping objects and Arrays

     

    Dump all objects of specific type:

     

    000007fc76a73e48       47         6768 System.Configuration.SectionInformation

    !dumpheap -type System.Configuration.SectionInformation

     

    Recursively dump all objects of a certain type

    .foreach (obj { !dumpheap -type Microsoft.TeamFoundation.Framework.Server.IdentityDescriptor -short }) { !mdt ${obj} -r}

     

    Dump a specific property of all objects from this type

     

    First get the offset of the property you need to print (easiest way is to just dump one of the objects and copy the offset)

     

    0:033> !do 0000001834b180b8

    Name:        System.Configuration.SectionInformation

    MethodTable: 000007fc76a73e48

    EEClass:     000007fc76a14c58

    Size:        144(0x90) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_MSIL\System.Configuration\v4.0_4.0.0.0__b03f5f7f11d50a3a\System.Configuration.dll

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    000007fc76a732d0  40001be        8 ...figurationSection  0 instance 0000001834b17c78 _configurationSection

    000007fc76a73788  40001bf       68 ...n.SafeBitVector32  1 instance 0000001834b18120 _flags

    000007fc76a73740  40001c0       70 ...SimpleBitVector32  1 instance 0000001834b18128 _modifiedFlags

    000007fc76a76220  40001c1       60         System.Int32  1 instance              300 _allowDefinition

    000007fc76a76280  40001c2       64         System.Int32  1 instance              100 _allowExeDefinition

    000007fc76a75ed8  40001c3       10 ...nfigurationRecord  0 instance 0000000000000000 _configRecord

    000007fc782faee0  40001c4       18        System.String  0 instance 000000183469a030 _configKey

    000007fc782faee0  40001c5       20        System.String  0 instance 0000001834699908 _group

    000007fc782faee0  40001c6       28        System.String  0 instance 0000001834699ef0 _name

    000007fc782faee0  40001c7       30        System.String  0 instance 0000001834699f28 _typeName

    000007fc782faee0  40001c8       38        System.String  0 instance 0000000000000000 _rawXml

    000007fc782faee0  40001c9       40        System.String  0 instance 0000000000000000 _configSource

    000007fc782faee0  40001ca       48        System.String  0 instance 0000000000000000 _configSourceStreamName

    000007fc76a7a048  40001cb       50 ...igurationProvider  0 instance 0000000000000000 _protectionProvider

    000007fc782faee0  40001cc       58        System.String  0 instance 0000000000000000 _protectionProviderName

    000007fc76a73a50  40001cd       78 ...errideModeSetting  1 instance 0000001834b18130 _overrideModeDefault

    000007fc76a73a50  40001ce       80 ...errideModeSetting  1 instance 0000001834b18138 _overrideMode

     

    And then loop through all objects of this type and dump this property

    .foreach (foo {!DumpHeap -type System.Configuration.SectionInformation  -short}) {!do poi(${foo}+28)}

     

    Sample Output

    Name:        System.String

    MethodTable: 000007fc782faee0

    EEClass:     000007fc77c63720

    Size:        32(0x20) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\mscorlib\v4.0_4.0.0.0__b77a5c561934e089\mscorlib.dll

    String:      uri

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    000007fc782fdc90  40000aa        8         System.Int32  1 instance                3 m_stringLength

    000007fc782fc1c8  40000ab        c          System.Char  1 instance               75 m_firstChar

    000007fc782faee0  40000ac       18        System.String  0   shared           static Empty

                                     >> Domain:Value  0000001833796360:NotInit  00000018337ed9e0:NotInit  <<

    Name:        System.String

    MethodTable: 000007fc782faee0

    EEClass:     000007fc77c63720

    Size:        60(0x3c) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\mscorlib\v4.0_4.0.0.0__b77a5c561934e089\mscorlib.dll

    String:      webRequestModules

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    000007fc782fdc90  40000aa        8         System.Int32  1 instance               17 m_stringLength

    000007fc782fc1c8  40000ab        c          System.Char  1 instance               77 m_firstChar

    000007fc782faee0  40000ac       18        System.String  0   shared           static Empty

                                     >> Domain:Value  0000001833796360:NotInit  00000018337ed9e0:NotInit  <<

    Name:        System.String

    MethodTable: 000007fc782faee0

    EEClass:     000007fc77c63720

    Size:        50(0x32) bytes

    File:        D:\Windows\Microsoft.Net\assembly\GAC_64\mscorlib\v4.0_4.0.0.0__b77a5c561934e089\mscorlib.dll

    String:      defaultProxy

    Fields:

                  MT    Field   Offset                 Type VT     Attr            Value Name

    000007fc782fdc90  40000aa        8         System.Int32  1 instance               12 m_stringLength

    000007fc782fc1c8  40000ab        c          System.Char  1 instance               64 m_firstChar

    000007fc782faee0  40000ac       18        System.String  0   shared           static Empty

                                     >> Domain:Value  0000001833796360:NotInit  00000018337ed9e0:NotInit  <<

     

    ]]>