How are you testing the connection between both sides?
Compare OS firewall settings on both servers and make sure that ICMP traffic is allowed if using ping.
Are the servers placed in the same subnet?
Check if NSG / route table settings are the same.
If nothing works I would suggest taking network traces using the tool of your choice.
I hope this helps!
----------
Please don’t forget to "Accept the answer" and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.