To me this may be the expected behavior.
It may take a while for the information to be updated in the backend.
And since chat messages are stored in Exchange mailbox, you would still be able to search the chat history.
Please wait some time and see it would update correctly.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.