Here’re steps:
1.Go to Microsoft 365 admin center -> Active groups -> Add a group -> Security -> Add owner and members in the security group.
2.Go to the library -> Select the folder -> Manage access -> Advanced -> Stop Inheriting Permissions -> Grant permission -> Select the security group.

If an Answer is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.