Hi @Jerry Lorey,
I'm afraid all users who have access to the folder can open or make changes to a folder even if another user is working in it. It seems that the current alternative is to remove the other users' access and add them back after then.
Also, you can use SharePoint Online document library. It has check out/check in feature which meets the requirement in this scenario.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.