Hi Andre
First and foremost: Thanks for your help!
I have found a way to fix my computer now.
Maybe this will be helpful to others.
I made a Windows to go USB stick and booted Windows from there. Like that I could access all my files and drives from my computer while being in Windows.
Knowing exactly which registry entry I broke by deleting two keys and knowing it was in the SYSTEM part of the registry, I navigated to the drive my broken Windows was located to Windows\System32\config, located in that folder is the SYSTEM registry hive along with all other registry hives.
So I opened regedit on my Windows to go and then loaded the broken SYSTEM registry hive in there. I navigated to where I deleted the two keys and re-created them with the names, values and types matching what they were when I deleted them (this part requires knowing what those values and types would be). All that was left to do now was unload the hive and reboot the system and tada. Everything back to normal as if I never broke anything.
So glad I didn't reset Windows.
Hope this helps other with similar issues.
With regards,
Sandro