Hi AndrewStueve,
The FQDN which you see under VPN settings resolve to Azure P2S Gateway's IP. It is static and it will not change until and unless you delete the gateway. You can do a nslookup to that FQDN and use that IP in your NSG.
Let me know if you have any further questions.