How to stop an Azure Batch service

Question

Hi,

To offload a lot of data processing we have started to use Azure Batch services by creating a dedicated vm for this purpose. This service is going to start the Batch service and process the data for us.

But we are not sure how to stop the service and vm post the processing. If we do not stop this will keep running indefinitely and incurs cost for us.

Any inputs are aprpeciated.

Thanks,
Kotesh

Answer 1

Hello @Koteswara Pentakota ,

Thank you for reaching out to the Microsoft Q&A platform. Happy to answer your question.

In case you have to run this data processing jobs regularly, you can use batch-job-schedule. By scheduling your jobs, you can make sure you use the least number of resources. Nodes can be decommissioned when not needed, and tasks that are dependent on other tasks are spun up just in time optimizing the workflows. In addition to that scheduling batch jobs enables you to prioritize the jobs you want to run first, while taking into account tasks that have dependencies on other tasks.

If you are looking for manually stopping a specific batch job here is a reference to it https://learn.microsoft.com/en-us/cli/azure/batch/job?view=azure-cli-latest#az-batch-job-stop

In general, customers can use auto scale formula to scale in the batch pool depending on task count. Azure Batch can automatically scale pools based on parameters that you define, saving you time and money. With automatic scaling, Batch dynamically adds nodes to a pool as task demands increase and removes compute nodes as task demands decrease.

For more details on how to set auto scale formulas, you can follow the below link
https://learn.microsoft.com/en-us/azure/batch/batch-automatic-scaling#autoscale-formulas.

--please don't forget to upvote and accept as answer if the reply is helpful--