Location
Looking at the Azure geographies, East Asia should be the closest so that is correct:
https://azure.microsoft.com/en-us/global-infrastructure/geographies/
Bandwidth
This can be difficult to estimate as most of the traffic is generated by the user but for most scenarios 3 Mbps should be enough (you shouldn't have any issues with 100 Mbps). You can see examples of bandwidth required for different scenarios here:
https://learn.microsoft.com/en-us/azure/virtual-desktop/rdp-bandwidth#estimating-bandwidth-used-by-remote-graphics
- Idle: 0.3 Kbps
- Microsoft Word: 100 - 300 Kbps
- Microsoft Excel: 150 - 500 Kbps
- Web browsing: 1 - 6.5 Mbps
- Image gallery: 0.7 - 3.5 Mbps
- Video playback: 2.5 - 9.5 Mbps
- Fullscreen video playback: 2.5 - 8.5 Mbps
Latency
Latency is critical for interactive use and I suspect this is what is causing issues for you. Most often this is a limitation of your internet service provider:
https://learn.microsoft.com/en-us/azure/virtual-desktop/connection-latency
- Latency up to 150 ms shouldn't impact use
- 150 ms - 200 ms should be fine for text
- 200 ms or more will have a noticeable impact
There are two tools I recommend for determining your latency:
Azure Virtual Desktop Experience Estimator
https://azure.microsoft.com/en-us/services/virtual-desktop/assessment/
Azure Speed Test
http://azurespeedtest.azurewebsites.net/
Troubleshooting
If you think the issue is with your VM and not the connection from your internet service provider, there are tests you can run to troubleshoot your VM network latency:
https://learn.microsoft.com/en-us/azure/virtual-network/virtual-network-test-latency