OpenAI model deployment timeout issues

svetlio svetlio 0 Reputation points
2025-07-24T06:52:11.3333333+00:00

Since yesterday, requests to the completions endpoint of our OpenAI model deployment are timing out. We haven't made any changes on the code that's doing the requests or the infrastructure around it. I've tried switching to non-streaming requests as well as simplifying the prompt, but nothing changed, and still all requests are timing out.

Azure OpenAI in Foundry Models

2 answers

Sort by: Most helpful
  1. svetlio svetlio 0 Reputation points
    2025-08-01T07:18:34.15+00:00

    Hey, the problem resolves by itself after a day. At the time it was happening I've tried a minimal prompt and that also didn't work. I've also checked the status page but nothing was shown there.

    Was this answer helpful?

    0 comments No comments

  2. Pavankumar Purilla 11,655 Reputation points Moderator
    2025-07-30T11:50:02.59+00:00

    Hi svetlio svetlio,
    This issue is not related to any changes in your code or infrastructure but is likely caused by temporary service-side latency or capacity issues in the region where your deployment is hosted. We recommend first checking the Azure Status page to confirm if there are any ongoing service incidents. You can also try testing with a minimal prompt, increasing the request timeout, or switching to another region or model deployment to see if the problem persists. If the issue continues even with simple requests, it may be regional and not specific to your deployment. Please let us know if you are still facing the issue.

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.