Hi,
Did you check the Network throughput of that VM? https://learn.microsoft.com/en-us/azure/virtual-network/virtual-machine-network-throughput
Also try NTTCP tool to verify the download and upload speeds-https://learn.microsoft.com/en-us/azure/virtual-network/virtual-network-bandwidth-testing
BTW -B Series is specific to development and test servers, low-traffic web servers, small databases, micro services, servers for proof of concepts and build servers.
Also try to optimise the Network components on the VM and see if it makes any difference.
Hope this helps.
JS
==
Please accept as answer and do a Thumbs-up to upvote this response if you are satisfied with the community help. Your upvote will be beneficial for the community users facing similar issues.