I have noticed similar behaviour, but thankfully not that much that it has become a burden. One problem can be if you have lost a connection to an instance, for instance due to a network corruption. Or when I have made the mistake to shutdown a VM, when I have an open query window to an instance on that VM.
When I think of it, I had some problems in Object Explorer at my client, which I have not seen for a while. It could be that they have fixed something in more recent versions of SSMS - the current version is 18.7.1. It could also be that there used to be network issues at my client which they have fixed.