Azure ML web endpoint unreachable after successful deployment

asked 2020-09-23T19:42:07.103+00:00
Jens Christian Johannsen 1 Reputation point

The deployment state of the service is marked as being unhealthy.

Compute target is AKS.

27654-capture.png

The pod is running and the logs says that the init() completed successfully.

Also, when deploying it as a local web service it works.

Model size is small, execution time is < 2 min and we are requesting 0.7 cpu and 0.5 Gb mem. Increasing these requests does not solve it, so guess that it's not related to request limit.

However, when trying to consume the scoring service, an 504 error is returned saying that:

RROR - Received bad response from Model Management Service:
Response Code: 504
Headers: {'Date': 'Wed, 23 Sep 2020 18:44:31 GMT', 'Content-Type': 'text/html', 'Content-Length': '160', 'Connection': 'keep-alive', 'x-request-time': '180.032', 'Strict-Transport-Security': 'max-age=15724800; includeSubDomains; preload'}
Content: b'<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx</center>\r\n</body>\r\n</html>\r\n'

Guess this should be fixed on AKS. But what should be done? Any help much appreciated.

Container logs:

27761-capture2.png

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
1,619 questions
{count} votes