AVD Start on connect issue - User connection times out with RDBroker errors
We have a host pool set up with a multi-session desktop, and have Start On Connect configured. So the VM will shut down if nobody has used it for a while, and when a user tries to connect, it will start back up, then connect them.
A lot of the time this works as intended. But occasionally, users will experience a longer than usual wait when connecting, and ultimately it will give them an error that the connection timed out. In the Monitoring insights in portal.azure.com it will show the following connection errors from Source RDBroker:
ConnectionFailedUserHasValidSessionButRdshIsUnhealthy
Or
ConnectionFailedOrchestrationVMStartedButUnhealthy
And when this happens, the user sometimes can't connect for an hour or longer, then eventually it just starts working again. While it is happening for one user, others can connect just fine. I have tried searching around the internet for these errors but cannot find much of anything on them, so I have no idea where to start for troubleshooting.
The subscription has the Desktop Virtualization Power On Contributor role assigned. It works most of the time, and it has occurred for several different users at different times so it does not seem to be a user-specific problem. All users are connecting via the Windows App.