We are getting too many request timed out errors too frequently while using Azure open AI

Gaurav Rozatkar 0 Reputation points
2024-06-11T13:11:10.05+00:00

I frequently get request timeout errors from Azure OpenAI while using RetrievalQA from Langchain. This happens usually around 10:00 a.m.–2:00 p.m. UTC. I have already implemented exponential backoff, but the issue still seems to be happening often.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,619 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,633 questions
{count} votes