I found a workaround which might work for you (my use case is a bit different with Hyper-V, see comment above).
When this happens, I do the following:
- Type Windows Key + "D" to minimize all windows and go back to Desktop
- Right-click 2 times on an empty area on the Desktop: the 1st one does nothing, the 2nd one opens the Desktop menu.
- Mouse left-click works again.
Let me know if it helps.