Additional meeting and call-related features and issues within Microsoft Teams for business
Hi, Janina,
My name is Didi. I'm happy to help you today.
After clicking on the 'Do not disturb' option for your status, a message as shown in the screenshot should appear. When you click on 'Change settings', you'll be directed to Privacy. Click 'Manage priority access' under 'Do not disturb' then type in your boss's name so you can still receive notifications for chats, calls, and @mentions from them.
I hope this helps.
Best regards,