Hi @נימרוד ונדר , welcome to Microsoft Q&A forum.
I tried connecting to Azure PostgreSQL - Single Server through Azure Data Studio and was able to connect without any issue.
Can you please run the command 'Developer: Open Logs Folder' as shown below and check the latest logs if that gives any information: