Can we schedule managed endpoints to start during the day and turn off during the night ?

Anonymous

I need a powerful virtual machine for my managed endpoint which has my machine learning model deployed. However most of the time it's not being utilized. I would like to optimize it such that it's not active during the night and it starts again during the day. This would reduce my cost by half and allow me to preserve un-utilized resources.

What are the possible ways this could be done ?
Which one is suggested ?
Is there anything else I can do to solve my problem here ?

Anonymous

2023-06-05T05:43:28.1133333+00:00

+Is there a way to change the VM for the managed online endpoints ? Say a gpu during the day and a cpu during the night ?
Sreeju Nair 11,606 Reputation points

2023-06-05T07:43:57.39+00:00

Changing the VM size is generally known as Vertical Scaling. You can do vertical scaling of Azure Virtual Machine using Azure automation. Refer the following URL for more details.

https://github.com/uglide/azure-content/blob/master/articles/virtual-machines/virtual-machines-windows-vertical-scaling-automation.md

Hope this helps
romungi-MSFT 42,116 Reputation points Microsoft Employee

2023-06-06T11:25:22.1533333+00:00

@Anonymous I think you could try configuring autoscaling profile for your online endpoint and define a scaling rule that best applies for your scenarios. Please see this page for details.
romungi-MSFT 42,116 Reputation points Microsoft Employee

2023-06-07T15:34:07.48+00:00

@Anonymous Just curious to check if autoscaling options available for endpoints works for your scenario.

1 answer

Sreeju Nair 11,606 Reputation points

2023-06-05T05:49:47.0766667+00:00

You can configure Start/Stop VMs options; the Start/Stop VMs feature allows you to start or stop the Azure VMs based on user-defined schedules.

Refer: https://learn.microsoft.com/en-us/azure/automation/automation-solution-vm-management

https://learn.microsoft.com/en-us/azure/azure-functions/start-stop-vms/overview

Hope this helps
Please sign in to rate this answer.
Anonymous

2023-06-05T08:59:12.94+00:00

@Sreeju Nair Would that work for managed online endpoints ? Because I'm not creating VM separately, I'm just creating the online endpoint and specifying the compute name.

Anonymous

2023-06-05T11:30:40.18+00:00

@Sreeju Nair your solution didn't work. i havent created a virtual machine which i could turn on and off, i have created an online managed endpoint. Please suggest the solution accordingly.

Sreeju Nair 11,606 Reputation points

2023-06-05T12:23:44.19+00:00

For Machine learning compute instance, refer the following URL, that shows you how to start and stop the instances.

https://learn.microsoft.com/en-us/azure/machine-learning/how-to-create-manage-compute-instance?tabs=python&view=azureml-api-2#schedule-automatic-start-and-stop

Hope this helps

Poda Csanad 0 Reputation points

2024-01-31T08:49:09.6566667+00:00

@Sreeju Nair he's asking about online endpoints, and you're talking about compute instances. They're not the same.
Sign in to comment