Hi,
If you are able to reach On-Prem via Azure VM, that means there are no IP connectivity issue. It might be with the Windows Firewall or NSG or your On-Premises firewall which might be blocking the ICMP packets. Can you try to perform any Layer 4 connectivity test like telnet on RDP or SSH ports ?
Regards,
Karthik Srinivas