@Anonymous Thank you for your patience over the matter!!! I had discussion internally and got below response:
You should always use SQL AG Virtual Network Name (VNN), not WSFC VNN, to connect to the AG
It is not supported to use WSFC VNN to connect to AG
If you use WSFC VNN, the connection can go to secondary replica, if the secondary replica node is the active node in the cluster
You will need to configure listener IP to the load balancer https://learn.microsoft.com/en-us/azure/azure-sql/virtual-machines/windows/availability-group-manually-configure-tutorial#create-an-azure-load-balancer
Optionally you can add the cluster core IP to the LB to avoid duplicate use of the IP in the network https://learn.microsoft.com/en-us/azure/azure-sql/virtual-machines/windows/availability-group-manually-configure-tutorial#add-the-cluster-core-ip-address-for-the-windows-server-failover-cluster-wsfc
Hope it helps!!!
Please “Accept as Answer” if it helped so it can help others in community looking for help on similar topics.