Welcome to Microsoft Q&A Platform, thanks for posting your query here.
Azure VM configuration is defined by the VM SKU Type and users can select depending on the workload type. You can start to deploy a smaller VM and later can also upgrade the VM SKU if need arise.
GPU SKU VM sizes are little expensive, as these sizes are designed for compute-intensive, graphics-intensive, and visualization workloads.
For your VM requirement you have to choose the GPU Type VM SKU, and based on minimum possible CPU and RAM the size you can go is NC4as T4 v3
Ensure you have enough Quota for this VM SKU in your subscription.
Please use this VM Selector tool to check what VM SKU you need to pick.
Hope that helps.
If the suggested response helped you resolve your issue, please 'Accept as answer', so that it can help others in the community looking for help on similar topics.