Disable Game Optimization Windows 11

I cannot tell you how much Game Optimization in Windows 11 annoys the living **** out of me. Whenever I launch a game on my PC, at the left corner a little meter appears to say that it is optimizing Windows and all Apps to run my games better. On Windows 10 I never needed this and I was fine without it. However, when Windows 11 does this, it absolutely KILLS all background process. When I alt tab out of my games or open a new window of some sort, it can barely open. Just opening Edge and takes two minutes, and then when I type, there is a 5 second delay. When I get invites to Xbox parties (I'm not even going to start on how bad the Xbox App and Game Bar is on Windows 11), I can't even join them. I have to close my game every single time I try to do something. I should also mention I have a gaming PC, with 16gb of RAM. This is unacceptable! I should not have to close my games just so Windows can go back to being normal and so I can do something. When I initally looked this problem, everything pointed to Game Mode. So, I turned it off. However, it has changed absolutely nothing. Windows still optimizing for every game I try to play, which also annoyingly closes my music every single time. And every time something pops up, like I need to google something, or my friends send me something, I have to close my game just to open and even view it. This should be something that can turned off. If there is a way, please, for the love of god show me how to turn it off!!!