Hello Tobias
Thanks for reaching out! My name is Fred I'm an Independent Advisor and a Windows user like you.
In OneNote for Windows 10 try to change the language in Windows following these steps:
Click on the windows icon on the left corner -> settings -> time & language -> language ->Choose your language or add someone and put it at prefer language
I hope this information is useful to you.
Best Regards,
Fred