aks Module

Contains functionality for deploying machine learning models as web service endpoints on Azure Kubernetes Service.

Azure Kubernetes Service (AKS) is recommended for scenarios where you need full container orchestration, including service discovery across multiple containers, automatic scaling, and coordinated application upgrades.

For more information, see Deploy a model to Azure Kubernetes Service.

Classes

AksEndpoint

Note

This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.

Represents a collection of web service versions behind the same endpoint running on Azure Kubernetes Service.

Whereas a AksWebservice deploys a single service with a single scoring endpoint, the AksEndpoint class enables you to deploy multiple web service versions behind the same scoring endpoint. Each web service version can be configured to serve a percentage of the traffic so you can deploy models in a controlled fashion, for example, for A/B testing. The AksEndpoint allows deployment from a model object similar to AksWebservice.

Initialize the Webservice instance.

The Webservice constructor retrieves a cloud representation of a Webservice object associated with the provided workspace. It will return an instance of a child class corresponding to the specific type of the retrieved Webservice object.

AksEndpointDeploymentConfiguration

Note

This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.

Represents deployment configuration information for a service deployed on Azure Kubernetes Service.

Create an AksEndpointDeploymentConfiguration object using the deploy_configuration method of the AksEndpoint class.

Initialize a configuration object for deploying an Endpoint to an AKS compute target.

AksServiceAccessToken

Describes the access token that can be specified in the Authorization header of scoring requests to Webservice.

Create a new instance of WebServiceAccessToken.

AksServiceDeploymentConfiguration

Represents a deployment configuration information for a service deployed on Azure Kubernetes Service.

Create an AksServiceDeploymentConfiguration object using the deploy_configuration method of the AksWebservice class.

Initialize a configuration object for deploying to an AKS compute target.

AksWebservice

Represents a machine learning model deployed as a web service endpoint on Azure Kubernetes Service.

A deployed service is created from a model, script, and associated files. The resulting web service is a load-balanced, HTTP endpoint with a REST API. You can send data to this API and receive the prediction returned by the model.

AksWebservice deploys a single service to one endpoint. To deploy multiple services to one endpoint, use the AksEndpoint class.

For more information, see Deploy a model to an Azure Kubernetes Service cluster.

Initialize the Webservice instance.

The Webservice constructor retrieves a cloud representation of a Webservice object associated with the provided workspace. It will return an instance of a child class corresponding to the specific type of the retrieved Webservice object.

AutoScaler

Defines details for autoscaling configuration of a AksWebservice.

AutoScaler configuration values are specified using the deploy_configuration or update methods of the AksWebservice class.

Initialize the AKS AutoScaler.

ContainerResourceRequirements

Defines the resource requirements for a container used by the Webservice.

ContainerResourceRequirement values are specified when deploying or updating a Webervice. For example, use the deploy_configuration or update methods of the AksWebservice class, or the create_version, deploy_configuration, or update_version methods of AksEndpoint class.

Initialize the container resource requirements.

DataCollection

Defines data collection configuration for an AksWebservice.

Intialize the DataCollection object.

LivenessProbeRequirements

Defines liveness probe time requirements for deployments of the Webservice.

LivenessProbeRequirements configuration values values are specified when deploying or updating a Webervice. For example, use the deploy_configuration or update methods of the AksWebservice class, or the create_version, deploy_configuration, or update_version methods of the AksEndpoint class.

Initialize the container resource requirements.