Hi ,
Thanks for reaching out to Microsoft Q&A.
- The message “no healthy upstream” is typically returned when Azure's internal load balancer cannot route traffic to any healthy instances of your deployed model.
- Since it affects all invocation methods, and you have ruled out cold starts, it is probably:
- A regional outage or service degradation in East US.
- Or your specific containerized deployment is stuck in a failed or unhealthy state.
- Try a quick restart of the deployment (if possible):
- Navigate to Azure AI Doc Intelli -> Your Resource -> Model Management.
- Try restarting or redeploying your custom model.
- If that fails or is greyed out, it confirms a platform side issue.
- Test another region:
- If you have capacity, try deploying the same model to a different region (like West US or Central US) to check if the problem is regional.
Please 'Upvote'(Thumbs-up) and 'Accept' as answer if the reply was helpful. This will be benefitting other community members who face the same issue.