Hello @Emily Alsentzer !
Welcome to Microsoft QnA!
Is this setting on portal.azure.com ?
Please logout and re login from a Private Window if you made the change recently !
I hope this helps!
Kindly mark the answer as Accepted and Upvote in case it helped!
Regards