Azure HD Insights Spot instances.

HariKrishna-7067 120 Reputation points
2023-09-11T17:50:23.2666667+00:00

How to use the Azure HDInsights Spot instances.

What is the max limit here?

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
212 questions
0 comments No comments
{count} votes

Accepted answer
  1. Bhargava-MSFT 31,116 Reputation points Microsoft Employee
    2023-09-11T19:31:20.0266667+00:00

    Hello Hari Krishna,

    Welcome to the Microsoft Q&A forum.

    It is not possible to use spot VMS in HD insights.

    Using Azure Spot Virtual Machines allows you to take advantage of our unused capacity at a significant cost savings. At any point in time when Azure needs the capacity back, the Azure infrastructure will evict Azure Spot Virtual Machines.

    SPOT VMS are only applicable to:
    ✔️ Linux VMs ✔️ Windows VMs ✔️ Flexible scale sets ✔️ Uniform scale sets

    To enable SPOT instances on the virtual machine scale set, we must enable the option "Run with Azure spot discount."

    On the HDInsights cluster VMs, there is no option to enable "spot instances."

    This confirms that SPOT instances are not supported on the HDInsights cluster VMS.

    VM scale set:

    User's image

    HDInsight cluster VMs:
    User's image

    I hope this gives a clear understanding of the SPOT instances of HDInsights cluster VMs.

    Reference document:

    https://learn.microsoft.com/en-us/azure/virtual-machines/spot-vms

    A similar ask has been discussed here.

    Please let me know if you have any further questions.

    If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.