I opened a case with Microsoft, and the technician confirmed that users seeing this is a known issue and is currently being worked on by the Microsoft engineering team. It is supposed to not be visible, and only accessible on the back end of Teams used for closed captioning, transcripts, and Copilot. In some cases, it will show up for users after participating in 1:1 meetings, or large meetings.
Users can feel free to "Discard" the chat by clicking on the ... menu next to the chat title.
Statement from Microsoft's Engineering Teams about the CallRecorder Bot:
"The "Call Recorder Teams Prod" is a bot built by Microsoft Teams used for meeting recording, closed captions and transcripts. It is normally hidden for users during a meeting, but like any other bots that are installed for a user, the user has the ability to search and chat with that bot. This is the expected behavior, based on the current implementation, and this bot does not represent a threat to the user."