Sadly this problem is not fixed in build 22538.
Did a System File Check and Windows Resource Protection did not find any integrity violations.
Disabling Core Isolation Memory Integrity (VBS) did not make a difference, so I left it enabled.
I just discovered that the files open instantly when I disable "Check apps and files" under "Reputation-based protection" in the settings from Windows Defender, but my system is vulnerable this way and I don't want to keep it disabled.