Hello Bjarne,
I understand your frustration. Here are a few methods you can try to disable the CAPS Lock key:
Using Microsoft’s PowerToys: Download and install PowerToys from Github. Open PowerToys Settings via the Start Menu. Go to Keyboard Manager, click the “Remap a key” button. In the Remap keys dialog, press the Caps Lock key and then select “Disable” from the drop-down menu.
Using SharpKeys: SharpKeys is a utility that manages a Registry key that allows Windows to remap one key to any other key. You can use it to map the CAPS Lock key to a key that you do not use.
Using the Registry: You can also manually edit the Registry to disable the CAPS Lock key. However, this method is more complex and carries the risk of causing serious system problems if not done correctly.
Using NumLocker: NumLocker allows you to turn on/off Num Lock, Caps Lock, and Scroll Lock. You can use it to disable the CAPS Lock key.
https://www.howtogeek.com/713/disable-caps-lock-key-in-windows/