Getting error while scoring a ML model "ERROR: Met error <class 'Exception'>:No valid deployments to route to" on AKS via Azure DevOps Pipeline

Siddharth Joshi 211 Reputation points
2023-05-31T03:52:06.8733333+00:00

Hi,

I'm getting below error while scoring a ML model on AKS via Azure DevOps Pipeline.

Error:

ERROR: Met error <class 'Exception'>:No valid deployments to route to. Please check that the endpoint has at least one deployment with positive weight values or use a deployment specific header to route. [https://docs.microsoft.com/en-us/azure/machine-learning/how-to-safely-rollout-managed-endpoints#deploy-a-new-model-but-send-it-no-traffic-yet]

My ML Workspace, AKS its under Private network (Vnet & Private endpoint enabled ) with firewall.

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,714 questions
Azure Kubernetes Service (AKS)
Azure Kubernetes Service (AKS)
An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
1,983 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Ramr-msft 17,731 Reputation points
    2023-05-31T12:12:45.9133333+00:00

    @siddharth joshi Thanks for the question, Currently In Azure Machine Learning API/SDK/CLI v2 the AKS is not supported and will be supported in the near future.

    Here are the samples for Batch endpoint using the Azure ML Compute cluster.

    0 comments No comments