@Alon Krymgand Osovsky Apologies for the delay in response and all the inconvenience caused because of the issue.
Slowness in VM connectivity can be because of a number of reasons.
The performance diagnostics tool helps you troubleshoot performance issues that can affect a Windows or Linux virtual machine (VM).
Besides monitoring, you can also use Perfinsights which can provide a report with best practices recommendations and key bottlenecks around IO/CPU/Memory. Perfinsights is available for both Windows and Linux VM’s in Azure.
Below are few articles which might be beneficial to you:
https://learn.microsoft.com/en-us/azure/virtual-machines/troubleshooting/performance-diagnostics
As this issues need more investigation and live troubleshooting for quicker resolution I would recommend you to contact azure support to help them diagnose what's going on if an OS issue as it could be a range of things. If you have a support plan, requesting you to file a support ticket, else please do let us know, we will try and help you get a one-time free technical support.
Hope it helps :) !!!
Please 'Accept as answer' if it helped, so that it can help others in the community looking for help on similar topics