Hi @Naveen Neerukattu
Can you post screenshots of the structure? Is your load balance standard?
Make sure you are not using internal load balance, try to create a standard public ip and attach your vm's NIC.
I have load balance scenarios with public ip in vm, below a print of a basic load balance with ip in VM