An Azure service that is used to provision Windows and Linux virtual machines.
Hello, Emre Utku Solak!
The Fsv2 sizes series documentation page isn't entirely clear on its own because it quotes maximum speed which you may or may not see on your VM for the reasons listed in the other answers:
...a maximum single-core turbo frequency of 3.7 GHz.
What we're likely looking for is the expected performance of a VM. To help understand the compute power of different VMs, there used to be an ACU (Azure Compute Unit) page which would give you a sense of compute power. This has unfortunately been retired.
So while it's possible for the Fsv2-series to have a max boost clock of 3.7 GHz, speeds like you are reporting are within the expected range of performance. For speeds similar to what you have at home, I might look at other VMs as suggested in the other answers such as the Dav4 and Dasv4-series. For practical speeds closer to 3.7 GHz, I would look at the DCsv2-series or FX-series.