Cant access azure recources inside the vnet from a p2s vpn connection

Question

Soo i've setuped a VPN gateway inside a vnet that's peered with another vnet which holds my ILB ASE.

My goal was to use that gateway to establish a p2s connection with my ubuntu worker so I can deploy code on the ASE. I've setupped my certs as shown in the docs (https://learn.microsoft.com/en-us/azure/vpn-gateway/point-to-site-vpn-client-cert-linux#cli) and uploaded them onto the vnet gateway in the p2s configuration. In addition to that I've setupped route tables and peered the two networks, no NSG-s for the subnets. I can connect w/o problem but when i try to ping the ASE my request time outs. To troubleshoot i've added another ILB ASE in the VPN gateway network and when i ping it also timeouts. in the .ovpn file i've also added the following lines:

route 10.2.0.0 255.255.0.0 
route 10.3.0.0 255.255.255.0 
push "route 10.2.0.0 255.255.0.0"

because the inbound private ip of the ASE is 10.2.1.4. I've tried pinging from my windows pc (while connected ofcourse) and these were my route tables before i pinged:

Destination        Netmask          Gateway          Interface   Metric
10.1.0.0        255.255.0.0         10.3.0.1         10.3.0.2    281
10.2.0.0        255.255.0.0         10.3.0.1         10.3.0.2    281
10.3.0.0      255.255.255.0         On-link          10.3.0.2    281
10.3.0.0      255.255.255.0         10.3.0.1         10.3.0.2    281
10.3.0.2    255.255.255.255         On-link          10.3.0.2    281
10.3.0.255  255.255.255.255         On-link          10.3.0.2    281 ........

if i try "tracert 10.2.1.4":

Tracing route to 10.2.1.4 over a maximum of 30 hops

  1     *        *        *     Request timed out.
  2     *        *        *     Request timed out.
  3     *        *        *     Request timed out.
  4     *        *        *     Request timed out.

Not really sure why it doesnt work, what else do i need to setup (both on the client and azure) for this deploy scenario to work, and can i use the following code to deploy from ubuntu:

INTERFACE_NAME=$(ip addr show | grep -E "tun[0-9]+" -o | head -n 1) echo "INTERFACE_NAME=$INTERFACE_NAME" >> $GITHUB_ENV


curl --interface "${{ env.INTERFACE_NAME }}" -X POST 'https://10.1.1.4/api/deploy' \-H 'Authorization: Bearer ${{ secrets.AZURE_WEBAPP_PUBLISH_PROFILE }}' \-H 'Host: "my-web-app-name"'-H 'Content-Type: application/zip' \--data-binary '@/home/runner/work/"my-repo-name"/"my-repo-name"/"my-app-name"/bin/Release/net6.0/"my-app-name".zip'