@Justin H Welcome to the Microsoft Q&A forum, Thanks for posting your question.
Have you added client IP to allow the connection and you are still facing the issue? please check the troubleshooting document for more information.
https://learn.microsoft.com/en-us/azure/postgresql/flexible-server/concepts-firewall-rules
Please share some error screenshots and steps on how you are connecting.
Regards
Geetha