If you are unable to connect to your VMs via the load balancer front end IP / port, it is usually an issue with your LB configuration, backend health, or a firewall / NSG blocking the connection.
Your LB configuration will be setup using the Load Balancing Rules of your load balancer.
Azure Load Balancer will not route traffic to backends that are not reporting healthy via the Health Probes, so make sure your backend is healthy.
A Firewall or NSG can also block the connection, so make sure there are no firewalls in your envt / OS firewalls that block the traffic, and check your Network Security Groups (NSGs) on your Subnet / NICs of the VM.