Managing personal Outlook.com account settings, security, and privacy
Hi!
Welcome to Microsoft Q&A forum.
DNS records are not inside Outlook or Microsoft 365, they are inside your domain provider, such as GoDaddy, Namecheap, Cloudfare etc..
Check where you bought your domain, it usually have a DNS management section where you will see the needed information.