Hi @Matthew Fellows ,
Unfortunately, for your situation, there is no OOTB limit, you can try to use development methods to achieve it.
Regarding the list of previous logged in users, this is a feature of the web browser and not SharePoint Online itself. You can clear the list of previous logged in users by clearing your browser's cache and cookies.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.