
Hi Brian,
you need to deactivate the related licenses for the users. Two helpful reads including the powershell way to deactivate access to different MS365 Solutions on Tenant-base
I hope this information helps you resolves the questions.
Please accept as answer and upvote if the above information is helpful for the benefit of the community.