Hello Hari Krishna,
Welcome to the Microsoft Q&A forum.
It is not possible to use spot VMS in HD insights.
Using Azure Spot Virtual Machines allows you to take advantage of our unused capacity at a significant cost savings. At any point in time when Azure needs the capacity back, the Azure infrastructure will evict Azure Spot Virtual Machines.
SPOT VMS are only applicable to:
✔️ Linux VMs ✔️ Windows VMs ✔️ Flexible scale sets ✔️ Uniform scale sets
To enable SPOT instances on the virtual machine scale set, we must enable the option "Run with Azure spot discount."
On the HDInsights cluster VMs, there is no option to enable "spot instances."
This confirms that SPOT instances are not supported on the HDInsights cluster VMS.
VM scale set:
HDInsight cluster VMs:
I hope this gives a clear understanding of the SPOT instances of HDInsights cluster VMs.
Reference document:
https://learn.microsoft.com/en-us/azure/virtual-machines/spot-vms
A similar ask has been discussed here.
Please let me know if you have any further questions.
If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.