I feel your pain. This is very frustrating.
I just bought a new PC and KB5063060 was waiting to be installed. (The only software I have installed so far is HWiNFO to document my system hardware.) This Windows update failed three times and wasted three hours of my life cleaning up the files and retrying according to all the official suggestions. I've since installed Microsoft's "Show or hide updates" MiniTool to block this update and will wait for MS to fix this mess.
In summary: A clean/new install is no guarantee that KB5063060 can be installed successfully.