Hi @Yaseen Hashimi ,
Welcome to our forum!
Based on my test on New Outlook for windows (version 1.2023.911.900), i get the same result as yours. I'm afraid that it's by design and i didn't find any option to change it. If you need to use this feature, it's suggested that you could turn off New Outlook button to switch to Legacy Outlook.
Please kindly understand that many functions are not designed at present. At present, what I can do for you is to submit feedback for your request and I have post here, and you could vote for it. If you have any suggestions or ideas, It's suggested that you could post here. Hope Microsoft will notice this in the future. Thank you for your understanding and support!
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.