Hi @ Robin Ganderton ,
Do you want to remove this shared mailbox from your organization?
You can refer to this link to delete this mailbox from M365 Admin Center instead of from EOP:
Delete or restore user mailboxes in Exchange Online | Microsoft Learn
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment". Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread