Azure Kubernetes Service
An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
2,447 questions
How to fix Azure Machine Learning extension deployment in AKS?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 83%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDJ%3C/text%3E%3C/svg%3E)
Derick John
0
Reputation points
I ran the below command in Azure cloud shell:
az k8s-extension create --name test-ml-extension --extension-type Microsoft.AzureML.Kubernetes --config enableInference=True allowInsecureConnections=True inferenceRouterServiceType=LoadBalancer --cluster-type managedClusters --cluster-name test-kubernetes28a922149 --resource-group training-vm_group --scope cluster
And got the following error:
(ExtensionOperationFailed) The extension operation failed with the following error: Error: [ InnerError: [Helm installation failed : : InnerError [release test-ml-extension failed, and has been uninstalled due to atomic being set: failed pre-install: 1 error occurred:
* pod healthcheck failed
]]] occurred while doing the operation : [Create] on the config, For general troubleshooting visit: https://aka.ms/k8s-extensions-TSG, For more application specific troubleshooting visit: Troubleshooting: https://aka.ms/arcmltsg.
Code: ExtensionOperationFailed
Message: The extension operation failed with the following error: Error: [ InnerError: [Helm installation failed : : InnerError [release test-ml-extension failed, and has been uninstalled due to atomic being set: failed pre-install: 1 error occurred:
* pod healthcheck failed
]]] occurred while doing the operation : [Create] on the config, For general troubleshooting visit: https://aka.ms/k8s-extensions-TSG, For more application specific troubleshooting visit: Troubleshooting: https://aka.ms/arcmltsg.
So I ran the following command to Troubleshoot:
kubectl describe configmap -n azureml arcml-healthcheck
And got back this:
Name: arcml-healthcheck
Namespace: azureml
Labels:
Azure Kubernetes Service
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 24%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Abiola Akinbade 29,405 Reputation points Volunteer Moderator2025-06-22T10:37:15.7866667+00:00 I could try to assist you in troubleshooting here:
It looks like that the Azure ML extension's pre-install health check is failing during the Helm installation process. I would recommend you verify resource usage:
# Check node status kubectl get nodes # Check resource usage kubectl top nodes kubectl top pods --all-namespaces # Check for any failing pods kubectl get pods --all-namespaces | grep -v RunningYou should then remove remnant resources still available that may be preventing the deployment
See also:
When redeploying monitor the events to be sure as well
kubectl get events --sort-by=.metadata.creationTimestamp -n azuremlYou can mark it 'Accept Answer' and 'Upvote' if this helped you
Regards,
Abiola
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 38%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Markapuram Sudheer Reddy 2,050 Reputation points Microsoft External Staff Moderator2025-06-23T06:06:39.19+00:00 Hi Derick John,
Ensure you provide a valid, trusted SSL certificate and that the CNAME matches the certificate.
az k8s-extension create --name azureml-training-extension --extension-type Microsoft.AzureML.Kubernetes --config enableTraining=True enableInference=True inferenceRouterServiceType=LoadBalancer sslCname=<your CN name> --config-protected sslCertPemFile=cert.pem sslKeyPemFile=key.pem --cluster-type managedClusters --cluster-name CLUSTERNAME --resource-group RGNAME --scope cluster
Ensure your AKS cluster uses supported VM sizes for the extension and check that node pools have the right instance types and sufficient resources.
If the information is helpful, please click on "Upvote"
If you have any queries, please do let us know, we will help you.
-
Derick John 0 Reputation points
2025-06-26T03:12:24.1933333+00:00 Hi,
So I was able to resolve the issue by running the commands here. I ran the commands to delete the legacy azureml-fe components in the AKS cluster.
Sign in to comment
Sign in to answer