Unable to create HDInsight cluster using Microsoft tutorial

Justin Birchard 1 Reputation point
2020-12-21T18:46:02.527+00:00

I am a student trying to learn how to setup HDInsight Hadoop cluster. I have signed up and received the free $200 credit. I am following the steps laid out in Microsoft's tutorial here: https://learn.microsoft.com/en-us/azure/hdinsight/hadoop/apache-hadoop-linux-create-cluster-get-started-portal . But after trying many times, I cannot get past the "Review + create" screen. It says there is an error in the "Configuration + pricing" section of the setup, however this was not covered in the tutorial. I have tried changing the region and adjusting the amount of nodes, but no matter what I do I always receive this error: > There are not enough cores available to support the selected number of nodes. Please adjust the number of worker nodes selected or pick a different region. And sometimes I am also receiving this error: > You have reached your subscription's cores quota limit in Canada Central. Please choose a different region or request billing support to increase your limit for Canada Central. The value must be between 1 and 1. I am very new to this and have been unable to find any clues as to what I am doing wrong. Thank you for your help.

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
198 questions

4 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. PRADEEPCHEEKATLA-MSFT 76,921 Reputation points Microsoft Employee
    2020-12-23T05:17:26.717+00:00

    Hello @Justin Birchard ,

    You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a East US region.

    Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

    Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

    How to check Usage + Quotas for your subscription?

    Select your subscription => Under Settings => Usage + quotas => Use filter to select "Microsoft.Compute" & "East US" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.

    50662-image.png

    Reference: Resolve errors for resource quotas

    Hope this helps. Do let us know if you any further queries.

    ------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.
    2 people found this answer helpful.
  2. MartinJaffer-MSFT 26,021 Reputation points
    2020-12-22T01:20:17.437+00:00

    Hello @Justin Birchard and welcome to Microsoft Q&A.

    Could you clarify which subscription offering you are using? If I recall correctly, a "pay-as-you-go" subscription is required to use HDInsight. HDInsight requires multiple cores to start. The VM tiers in some offerings may not be large enough for HDInsight.

    When upgrading from free to pay-as-you-go, the 200$ are carried over.

    HDInsight is an always-on service, and can eat through the money quickly, so be sure to delete it when you are done.

    1 person found this answer helpful.
  3. PRADEEPCHEEKATLA-MSFT 76,921 Reputation points Microsoft Employee
    2020-12-22T08:39:43.337+00:00

    Hello @Justin Birchard ,

    Welcome to the Microsoft Q&A platform.

    Currently the HDInsight Cluster is not available under the Azure free trial/Student/Pass subscription.

    For more details, refer Azure Free Trial - FAQ.

    Reason: Azure Free Trail has a limit of 4 cores, and you cannot create HDInsight cluster using a Free Trial Subscription because it requires more than 8 cores.

    You need to upgrade to a Pay-As-You-Go subscription to create Azure HDInsight clusters.

    Note: Free Trial subscriptions aren't eligible for limit or quota increases. If you have a Free Trial subscription, you can upgrade to a Pay-As-You-Go subscription.

    Hope this helps. Do let us know if you any further queries.

    ------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.
    1 person found this answer helpful.
  4. Aisha Jabeen 6 Reputation points
    2021-01-06T03:05:58.753+00:00

    Hi @PRADEEPCHEEKATLA-MSFT ,

    I am getting the same error while creating HDInsight cluster.

    I have a pay-as-you-go subscription. I tried to go to the subscription settings and followed the steps as per your answer, but it shows nothing for Microsoft.Compute.

    53873-hdinsight.jpg

    53856-hdinsight.jpg

    1 person found this answer helpful.