@Philipp Schäfer ，For the authenticator which is installed before the enrollment. based on my previous test experience, It will be kept. For the authenticator which installed during the enrollment, after researching, I didn't find the option to set to keep it. As a test, we suggest to remove the organization account from authenticator app and then un-enroll to see if it the result will be different.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.