Hi @phemanth firstly, thanks for helping. I really appreciate that.
I did try a lot of VM sizes and it was giving me sku error and sometimes quota error. Then, I starting monitoring the virtual machines here https://portal.azure.com/?quickstart=true#view/Microsoft_Azure_ComputeHub/ComputeHubMenuBlade/~/virtualMachinesBrowse and one of them just worked randomly. which was a 14gb 4 core general purpose VM. DSv4 series.