this account may not have enough cpu cores to satisfy this request

Question

I created one resource and inside them single azure data bricks but unable to create spark cluster inside them. as I created account 2 days back and still 14000 credits are available in it.
unable to identify the issue anyone who can help me, will be appreciated. I am using a free tier account and didn't create any resource yet.

Answer 1

Hello @unable to create spark cluster in Azure databricks ,

Welcome to Microsoft Q&A forum and thanks for reaching out here.

As per my understanding you might be using Azure Free Trail subscription. If that is the case then Azure Free trial subscription has a limit of 4 cores, and you cannot use Azure Databricks using a Free Trial Subscription to create spark cluster which requires more than 4 cores.

There is an Azure Databricks feature in Public Preview to create a Single node cluster. Currently, you can use Azure Free Trial subscription to create a Single node cluster which will have one Driver node with 4 cores.

A Single Node cluster is a cluster consisting of a Spark driver and no Spark workers. Such clusters support Spark jobs and all Spark data sources, including Delta Lake. In contrast, Standard clusters require at least one Spark worker to run Spark jobs.

Single Node clusters are helpful in the following situations:

• Running single node machine learning workloads that need Spark to load and save data
• Lightweight exploratory data analysis (EDA)

Reference: Azure Databricks - Single Node clusters

Hope this helps. Do let us know if you any further queries.

----------------------------------------------------------------------------------------

• Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators