Hi @Keith Andrews ,
You can try to use Remove-MsolGroup cmdlet to remove the associated MSOL object. For the detailed steps, please refer to: Office 365: Mail disable an on premises security group
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.