So an update, I think? I noticed today that this issue ONLY happens when I click out of my RDP session and into a chrome-based web browser. Both Chrome and Edge are causing this. Firefox is not.
And when I click in to any other program, including the desktop, taskbar or start menu, it is not happening either.
I did some basic testing once noticing this. I tried an incognito window and it still happened. I removed all my extensions in Edge and it still happened. I tried a portable install of Chrome that has zero extensions or history and it still happened.
I have not had any time to do more research into it, but maybe it will give those others having this issue something to start looking at. It will be interesting if this is a common thread that holds between all of us experiencing this.