Hi Mikulas Poul,
Thanks for reaching out to Microsoft!
Since the issue seems to be specific to a particular mailbox, I recommend raising a support case with Microsoft Graph. Please include the latest logs with the Client ID, request ID, and timestamp, a Support Engineer will be able to look into this issue and assist you better. You can raise support ticket from New support request - Microsoft Entra admin center or https://admin.microsoft.com/#/support/requests.
Hope this helps.
If the answer is helpful, please click Accept Answer and kindly upvote it. If you have any further questions about this answer, please click Comment.