NGV Welcome to Microsoft Q&A, Thank you for posting your here!!
You can try to connect to Azure VM from remote desktop connection App
Now get the public IP address of the VM from Azure Portal
Now try to paste the Public IP address in the Remote desktop connection and connect.
Hope this helps!
Kindly let us know if the above helps or you need further assistance on this issue.
Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.