Managed online endpoints SKU list

This table shows the VM SKUs that are supported for Azure Machine Learning managed online endpoints.

• The full SKU names listed in the table can be used for Azure CLI or Azure Resource Manager templates (ARM templates) requests to create and update deployments.

• For more information on configuration details such as CPU and RAM, see Azure Machine Learning Pricing and VM sizes.

Relative Size	General Purpose	Compute Optimized	Memory Optimized	GPU
V.Small	Standard_DS1_v2 Standard_DS2_v2	Standard_F2s_v2	Standard_E2s_v3	Standard_NC4as_T4_v3
Small	Standard_DS3_v2	Standard_F4s_v2	Standard_E4s_v3	Standard_NC6s_v2 Standard_NC6s_v3 Standard_NC8as_T4_v3
Medium	Standard_DS4_v2	Standard_F8s_v2	Standard_E8s_v3	Standard_NC12s_v2 Standard_NC12s_v3 Standard_NC16as_T4_v3
Large	Standard_DS5_v2	Standard_F16s_v2	Standard_E16s_v3	Standard_NC24s_v2 Standard_NC24s_v3 Standard_NC64as_T4_v3
X-Large	-	Standard_F32s_v2 Standard_F48s_v2 Standard_F64s_v2 Standard_F72s_v2 Standard_FX24mds Standard_FX36mds Standard_FX48mds	Standard_E32s_v3 Standard_E48s_v3 Standard_E64s_v3	Standard_ND40rs_v2 Standard_ND96asr_v4 Standard_ND96amsr_A100_v4

Caution

Standard_DS1_v2 and Standard_F2s_v2 may be too small to compute resources used with managed online endpoints. If you want to reduce the cost of deploying multiple models, see the example for multi models.