Hi Addy,
Thanks for reaching out to Microsoft Q&A.
Follow the below link which explains step-by-step instructions of how to set this alert with all options explained. I can give you the steps or refer to another answer, but nothing beats this. Try to compare this with your implementation and let me know if you are able to validate successfully.
Please 'Upvote'(Thumbs-up) and 'Accept' as an answer if the reply was helpful. This will benefit other community members who face the same issue.