Databricks cluster does not work with free trial subscription

Question

In Azure Databricks, tried to create cluster. Cluster creation requires to provide worker type and driver type, in which minimum 4 cores are required on each which means in total 8 cores.

Free trail subscription gives only 4 cores what I read. So how can I work on data bricks without increasing the cores limit? and free trail does not provide the scope to increase cores limit.

Answer 1

Hello @Seuli Das Majumder ,

Note: This feature is in Public Preview.

UPDATE: Currently, you can use Azure Free Trial subscription to create a Single node cluster which will have one Driver node with 4 cores.

A Single Node cluster is a cluster consisting of a Spark driver and no Spark workers. Such clusters support Spark jobs and all Spark data sources, including Delta Lake. In contrast, Standard clusters require at least one Spark worker to run Spark jobs.

Single Node clusters are helpful in the following situations:

• Running single node machine learning workloads that need Spark to load and save data
• Lightweight exploratory data analysis (EDA)

Reference: Azure Databricks - Single Node clusters

Hope this helps. Do let us know if you any further queries.

----------------------------------------------------------------------------------------

Do click on "Accept Answer" and Upvote on the post that helps you, this can be beneficial to other community members.

Answer 2

Hi SeuliDasMajumder-3800,

Thanks for reaching out. You are correct, Azure Free Trail subscription has a limit of 4 cores, and you cannot use Azure Databricks using a Free Trial Subscription because to create spark cluster which requires more than 4 cores

You could try below steps as a workaround:

• Create a free subscription
• Go to your profile and change your subscription to pay-as-you-go
• Remove the spending limit (steps here) to allow quota request.
• Request quota increase.
• When you create your Azure Databricks workspace, you can select the Trial (Premium - 14-Days Free DBUs) pricing tier to give the workspace access to free Premium Azure Databricks DBUs for 14 days.

Please refer to "Note" section in this doc: Tutorial: Extract, transform, and load data by using Azure Databricks

Hope this helps.

----------

Thank you

Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.