question

HarrySun-5008 avatar image
0 Votes"
HarrySun-5008 asked SurabhiSravan-8735 answered

ACI Service request failed

Hello,

I got an error when trying to deploy AML model. The tutorial I refer to is this: https://docs.microsoft.com/en-us/azure/machine-learning/how-to-deploy-and-where?tabs=python
Part of the console log is below.


2021-04-28 14:35:51-07:00 Registering the environment.
2021-04-28 14:35:53-07:00 Use the existing image.
2021-04-28 14:35:55-07:00 Submitting deployment to compute.
Failed
Service deployment polling reached non-successful terminal state, current service state: Transitioning
Operation ID: b6e3b3b3-d1f0-4819-81ac-b72c7b3582dd
Current sub-operation type not known, more logs unavailable.
Error:
{
"code": "InaccessibleImage",
"statusCode": 400,
"message": "ACI Service request failed. Reason: The image 'registryxdjudax3mnivo.azurecr.io/azureml/azureml_e1f2520e8a691cb15119fcbae8e452b7' in container
group 'myservice-dV-NN8cdrU2R5BJEiypZqQ' is not accessible. Please check the image and registry credential.. Refer to https://docs.microsoft.com/azure/cont
ainer-registry/container-registry-authentication#admin-account and make sure Admin user is enabled for your container registry."
}

Traceback (most recent call last):
File "deploy-model.py", line 34, in <module>
service.wait_for_deployment(show_output=True)
File "C:\Users\Administrator\source\repos\TestPython\venv\lib\site-packages\azureml\core\webservice\webservice.py", line 917, in wait_for_deployment
raise WebserviceException('Service deployment polling reached non-successful terminal state, current '
azureml.exceptions._azureml_exception.WebserviceException: WebserviceException:
Message: Service deployment polling reached non-successful terminal state, current service state: Transitioning
Operation ID: b6e3b3b3-d1f0-4819-81ac-b72c7b3582dd
Current sub-operation type not known, more logs unavailable.
Error:
{
"code": "InaccessibleImage",
"statusCode": 400,
"message": "ACI Service request failed. Reason: The image 'registryxdjudax3mnivo.azurecr.io/azureml/azureml_e1f2520e8a691cb15119fcbae8e452b7' in container
group 'myservice-dV-NN8cdrU2R5BJEiypZqQ' is not accessible. Please check the image and registry credential.. Refer to https://docs.microsoft.com/azure/cont
ainer-registry/container-registry-authentication#admin-account and make sure Admin user is enabled for your container registry."
}
InnerException None
ErrorResponse
{
"error": {
"message": "Service deployment polling reached non-successful terminal state, current service state: Transitioning\nOperation ID: b6e3b3b3-d1f0-4819
-81ac-b72c7b3582dd\nCurrent sub-operation type not known, more logs unavailable.\nError:\n{\n \"code\": \"InaccessibleImage\",\n \"statusCode\": 400,\n \
"message\": \"ACI Service request failed. Reason: The image 'registryxdjudax3mnivo.azurecr.io/azureml/azureml_e1f2520e8a691cb15119fcbae8e452b7' in container
group 'myservice-dV-NN8cdrU2R5BJEiypZqQ' is not accessible. Please check the image and registry credential.. Refer to https://docs.microsoft.com/azure/cont
ainer-registry/container-registry-authentication#admin-account and make sure Admin user is enabled for your container registry.\"\n}"
}
}



The python code used for this is below. The local deployment works actually.



from azureml.core import Environment
from azureml.core.model import InferenceConfig
from azureml.core.webservice import LocalWebservice
from azureml.core.webservice import AciWebservice
from azureml.core.model import Model
from azureml.core import Workspace

ws = Workspace.from_config(path="./config.json")

model = Model(ws, 'bidaf_onnx')
print(model.name, " : ", model.created_by)

env = Environment(name='myenv')
python_packages = ['nltk', 'numpy', 'onnxruntime']
for package in python_packages:
env.python.conda_dependencies.add_pip_package(package)

inf_config = InferenceConfig(environment=env, source_directory='./source_dir', entry_script='./score.py')
print("Generated inference configuration")

deploy_config = AciWebservice.deploy_configuration(cpu_cores = 0.5, memory_gb = 1)
print("Generated deployment configuration")

service = Model.deploy(ws, "myservice", [model], inf_config, deploy_config, overwrite=True)
service.wait_for_deployment(show_output=True)
print(service.get_logs())



I've enabled "Admin user" for the container registry as indicated by the error message. But still got the same error message.
Thank you,

Hai

azure-machine-learningazure-container-instancesazure-container-registry
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi, thanks for reaching out. Are you using an image from a private container registry? Are using Azure Container Instances in a virtual network?

0 Votes 0 ·

Thanks for the response. I checked with my service engineer and we're not including ACI in any virtual network. The image is from our ACR repo and it's not a private registry. Any other clue? Thank you.

0 Votes 0 ·

Since admin user has been enabled and you are still getting the error, I suggest contacting Azure Support. They may be in a better position to diagnose the issue further and provide quicker resolution. In the meantime, I'm reaching out to the product team to inquire more about this error and will share details with you accordingly. Sorry for any inconvenience.


0 Votes 0 ·
Praveen-9134 avatar image
0 Votes"
Praveen-9134 answered

We are having same issue, are there any updates to this forum?

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

SurabhiSravan-8735 avatar image
0 Votes"
SurabhiSravan-8735 answered

any update on this. running into same issue.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.