I'm new to Azure/Cloud computing and am finding some things confusing.
Today I upgraded my free trial, which gives me $200 for 30 days, to type Basic (no technical support). I had to provide my cc for that. Not sure what that really does, maybe I still have the free trial (I know I still have the $200 credits).
I believed that doing that would allow me to create a Databricks workspace where I could create a Compute resource with policy Unrestricted (say 1 driver and 1 worker), but it still says that my estimated quota of cores is 4 (so 1 driver machine at most, no workers). I can create a cluster only using policy Personal Compute, but not with the Unrestricted, see below.
This account may not have enough CPU cores to satisfy this request
Estimated available: 0, requested: 8
It seems there are a few many concepts, which can be confusing. A subscription that needs to be non-free (pay-as-you-go, if you want to, say, create a cluster with 1 driver and 1 worker), a resource group (tied to the non-free subscription) and a Databricks workspace (tied to the resource group).
It seems it's the policy that matters. I was trying to create one cluster that would let me pick 1 driver and 1 worker but even after going pay-as-you-go it wouldn't let me. If I pick the personal compute then it lets me create a cluster with one driver and no workers (well, maybe it will still work for my training, hopefully).
PS-good grief, it still doesn't let me create clusters in any configuration (one driver only, one driver and one worker). I picked region EAST-US, bc previously South Brazil was giving me availability error. Can somebody help?
Azure Quota Exceeded Exception: The VM size you are specifying is not available. [details] QuotaExceeded: Operation could not be completed as it results in exceeding approved standardDDSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: eastus, Current Limit: 0, Current Usage: 0, Additional Required: 4, (Minimum) New Limit Required: 4. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%22640fca4c-80a3-4ed7-bebe-33b72df4c06c%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22eastus%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDDSv5Family%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:4