Hello @Taha Yaseen
Yes the Solution is :
Create a VPN with Azure from the On Premises Firewall , type Site to Site VPN
https://learn.microsoft.com/en-us/azure/vpn-gateway/tutorial-site-to-site-portal
Provision a Load Balancer in Azure , type Public
https://learn.microsoft.com/en-us/azure/load-balancer/quickstart-load-balancer-standard-public-portal
Create a backend pool and add the virtual machine IP Addresses that you want to receive the incoming web traffic.

Create load balancing rules to define how the traffic should be routed to the VMs. Set the front-end port (e.g., port 80 for HTTP) and back-end port (the port on which your web server is listening).
OR
Create NAT Rules to redirect traffic to your VMs , it depends on the use , i can see you want Web Traffic so Load Balancing is the better option
Allow traffic from the Load Balancer to your VMs and to the Firewall , in case you pass the traffic to a Firewall first
notes : You must create Load Balancing rules on your Firewall so traffic is delivered equally if you dont have already one ....another solutions is Round Robin DNS...
Azure VPN will have the routing table in place so the n Premises IPs will be known . The Load Balancer will just send requests to a Private IP Pool ( 192.168.1.2, 1.3 , 1.4) so the VPN Gateway will send in turn the traffic to the On Premises Endpoint/Firewall.
Thats it in a High Level
We will offer any additional help , once you start ! So give it a go , with just one VM to see the drill!
I hope this helps!

Kindly mark the answer as Accepted and Upvote in case it helped!
Regards