Llama-3.3-70B-Instruct Serverless Endpoint Returning "No Callers" Error in East US 2

Falesiya Kunnan 0 Reputation points
2026-06-30T17:53:31.9366667+00:00

Our serverless endpoint Aptus-Llama-3-3-70B-Instruct in East US 2 (workspace: Project_Aptus_Lab) is returning the error: "No callers satisfying location tag 'us' found for model: llama-3.3-70b-instruct". The endpoint state shows Succeeded in the portal and the model shows Available in the model catalog, but all inference requests fail — including from the Azure portal's own Test tab. The endpoint worked on Monday June 23, 2026 morning and stopped working Monday evening without any changes on our side. This appears to be an East US 2 regional capacity issue for Llama-3.3-70B-Instruct.

Azure Machine Learning

2 answers

Sort by: Most helpful
  1. Andriy Bilous 12,186 Reputation points MVP
    2026-06-30T20:56:17.1733333+00:00

    Hello

    Based on the error text and the currently published deployment guidance, the most likely explanation is a routing compatibility issue related to the current deployment type.

    he model documentation currently lists Llama-3.3-70B-Instruct under Global Standard and Global Provisioned deployment paths, while the deployment-type guidance also notes that not all models support all deployment types. Because the error specifically references the US location tag (us), the failure appears to be happening during backend routing, before the request reaches the model endpoint.

    Please check if the following validation steps help-

    1. Redeploying the model using Global Standard
      1. Create a new deployment of Llama-3.3-70B-Instruct
      2. Select Global Standard as the deployment type
      3. Retest the deployment in Playground
    2. Confirming whether the issue is limited to Playground
      1. Test the same deployment through REST API or SDK
      2. If the same error appears outside Playground, that would confirm the issue is broader than the Playground experience and is likely tied to deployment routing itself
    3. Validating whether the issue is model-specific If another deployed model in the same Foundry project works successfully, that would help confirm that the behavior is specific to this deployment path for Llama-3.3-70B-Instruct, rather than a broader project or region issue. This is also a useful comparison point if escalation becomes necessary

    Reference
    https://learn.microsoft.com/en-us/answers/questions/5915335/error-in-ai-foundry-playground-using-llama-3-3?page=0#answer-12831951

    Was this answer helpful?

    0 comments No comments

  2. Anshika Varshney 14,705 Reputation points Microsoft External Staff Moderator
    2026-06-30T18:38:02.2433333+00:00

    Hello @Falesiya Kunnan

    Thank you for providing the details.

    Based on the error message "No callers satisfying location tag 'us' found for model: llama-3.3-70b-instruct", along with the fact that:

    • The endpoint deployment status shows Succeeded
    • The model remains Available in the Model Catalog
    • The issue occurs even from the Azure portal Test experience
    • The endpoint was previously working, and no configuration changes were made

    this does not appear to be an authentication, RBAC, or endpoint configuration issue. The failure seems to occur during backend request routing before the inference request reaches the model endpoint.

    To help narrow down the scope, could you please confirm:

    1. Does the same error occur when invoking the endpoint through the REST API or SDK, in addition to the portal Test experience?
    2. Are other serverless models in the same workspace and region working successfully?
    3. Can you share a recent correlation ID, request ID, and timestamp from a failed request?

    Since the endpoint is deployed successfully but requests cannot be routed to an available caller, this may require further investigation by the service team to verify backend model availability or regional routing capacity for Llama-3.3-70B-Instruct in East US 2.

    Thankyou.

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.