Hi aaron Emberger,
Welcome to Microsoft Community.
Alt + Enter shortcut key is used to switch between full screen mode and window mode.
The problem you are experiencing is related to graphics configuration.
The problem is actually caused by GeForce Experience provided by NVIDIA.
There should be another control panel for NVIDIA graphics cards, and there should be some reset options there too.
Features provided by GeForce Experience modify your graphics-related driver configuration files or game configuration files.
You may want to look for any feature buttons in GeForce Experience to restore configurations and check the settings for "Automatically optimize newly added games".
If you find similar configuration items, perform a restore or reset.
In addition, for the game itself, the screen configuration provided by the game may involve the selection of modes, such as full-screen mode, window mode, and borderless window mode.
You can adjust configuration items of this type for further observation.
Given the existence of GeForce Experience, the game's own configuration files may be overwritten by configuration files provided by GeForce Experience.
Besides, updating the driver will not modify the existing driver configuration or other game file configuration.
If possible, it's worth considering uninstalling and cleaning the NVIDIA driver, then reinstalling the NVIDIA driver to refresh the driver's state.
Thanks for your patience and understanding!
Best Regards,
Kyo - MSFT | Microsoft Community Support Specialist