Hi @Vinson Yuen ,
How many rules are there in the App Service's Access Restrictions?
Have you checked which Azure Virtual Machine's IP is in priority over the general blocking rule?
Have you tried using the Private Endpoins for Azure Web App?
Regards,
Kllin Nunes