Container Apps Health Check

Andrei Doroftei 30 Reputation points
2025-05-16T10:43:46.58+00:00

Why does the Health Check behave differently if the Ingress is enabled? I have a container with GPU, Vllm image used. I've used Azure Files to persist the cache (the downloaded model, etc.)

If the Ingress is disabled, the Health Check defined at the container level are used and everything works.

If the Ingress is enabled, those Health Checks are not used and the container is killed because it can't start fast enough.

I've already optimized the Start Up time to the maximum.
We are trying to leverage the use of Serverless GPUs but we fail to do so because of this.
I've already thought of a workaround of some kind, deploying a separate app along with the LLM container to respond to the Health Checks while the LLM container is starting. I haven't tested it until now.

Azure Container Apps
Azure Container Apps

An Azure service that provides a general-purpose, serverless container platform.

0 comments No comments

Answer accepted by question author
Michele Ariis 7,315 Reputation points MVP Volunteer Moderator
2025-05-16T12:37:41.8233333+00:00

Hi, when HTTP ingress is turned ON, Container Apps injects default probes (startup, liveness, readiness) that run in addition to or instead of your defined probes, but if ingress is OFF no default probes are added, this is why your GPU-heavy replica survives with ingress disabled but gets killed when enabled; the default startup probe hits your app’s exposed port with aggressive defaults (1s delay, 4 min max), and if it fails the replica is restarted in a loop; to fix this, define your own generous startup probe with longer thresholds matching your app’s warm-up time, or disable ingress if the container doesn’t need HTTP, or use TCP ingress to avoid Envoy’s strict handshakes.

Was this answer helpful?


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.