Hi Scott!
As luca said above, the people who left the meeting should also left the meeting conversation. After that, they cannot receive other participant's message and send messages in the meeting anymore .
Besides, you can also remove someone out of the chat manually. As a supplement, you can refer to: