Miscellaneous topics that do not fit into specific categories.
In Outlook 365 the Notifications settings are in General. Go to Settings > General > Notifications > Notify me about. You have to enable mail notifications and then under New email enable Show an envelope badge in the taskbar.
I found it by searching settings for envelope.
Good luck!