question

Srin-4824 avatar image
0 Votes"
Srin-4824 asked ramr-msft answered

Accessing different model versions from same endpoint

I am using model versioning and would like to have different model versions accessible via the same endpoint. Any best practices to access the multiple models from the same endpoint.

azure-machine-learning
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@Srin-4824 Thanks for the question. Are you deploying model to ACI?

0 Votes 0 ·

1 Answer

ramr-msft avatar image
0 Votes"
ramr-msft answered

@Srin-4824 Thanks, You may deploy “locally” to a Azure Machine Learning compute instance, by specifying different port # for each version. They are converted to a URL according to the format https://<compute instance’s name>-port.region.instances.azureml.ms/score

Model v1: service_url = https://azure-ml-compute-instance-name-8001.westeurope.instances.azureml.ms/score
Model v2: service_url = https:// azure-ml-compute-instance-name-8002.westeurope.instances.azureml.ms/score

There’s sample code in documentation. You can specify port to deploy with the following parameter.
deployment_config = LocalWebservice.deploy_configuration(port=8001)

We recommend using the new ML Endpoints (Preview) What are endpoints (preview) - Azure Machine Learning | Microsoft Docs.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.