@Rhyan Halliday Thanks for posting in our Q&A.
For this issue, I have noticed that it is M365 app. However, this setting you configured is for Microsoft Office 2016.
Based on my research, intune doesn't have this setting for M365 apps. If you are interested in this feature, it is suggested to post in intune feedback portal. It is a place to collect customers' requirements and questions. Here is the link:
https://feedbackportal.microsoft.com/feedback/forum/ef1d6d38-fd1b-ec11-b6e7-0022481f8472
Hope it will achieve in the future.
Thanks for your understanding.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.