Hello
Thank you for your question and reaching out. I can understand you are having query\issues related to Azure MFA with Windows 10/11.
Currently this is not possible. You cannot have multifactor via Authenticator app while Windows login. Microsoft does not provide any options like this. There are few third parties which allow doing this using some custom tool. You can read more on this thread.
--If the reply is helpful, please Upvote and Accept as answer--