Early termination in AzureML CLI pipeline

matsuo_basho 10 Reputation points
2024-01-24T17:17:03.37+00:00

I'm running a pipeline job using the AzureML cli syntax. https://learn.microsoft.com/en-us/azure/machine-learning/reference-yaml-job-pipeline?view=azureml-api-2 Is there a way to incorporate early stopping so that if the last epoch's loss (or whatever metric) doesn't improve above a certain threshold, then the job finishes?
I'm training on many epochs and would rather not waste compute resources (and waiting) if the metrics aren't improving.

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,421 questions
{count} votes

1 answer

Sort by: Most helpful
  1. dupammi 3,860 Reputation points Microsoft Vendor
    2024-01-25T09:04:50.2866667+00:00

    Hi @matsuo_basho ,

    Thank you for using Microsoft Q&A forum.

    It seems you can incorporate early stopping in your AzureML CLI pipeline job. AzureML provides several early termination policies that you can use to terminate a job if the primary metric doesn't improve above a certain threshold.

    You can find more information about these policies in the AzureML documentation: azureml-api-1#early-termination and azureml-api-2#early-termination

    Hope this helps.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful.