@Gerhart Jan Welcome to Microsoft Q&A Forum, Thank you for posting your query here
Microsoft doesn't have access to the keys Customer(you) is owner and responsible for the key lifecycle. We just provide the key vault as container for the key and also soft delete option but we don't have access to the keys.
Please let us know if you have any further queries. I’m happy to assist you further.
----------
Please do not forget to and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.