Azure OpenAi Responses API Timeout
Markus Jungnickel
0
Zuverlässigkeitspunkte
Very slow model response times on responses API since last 24h, causing the Openai SDK to time out. Major production impact on users. Pls advice.
See example: tiny request times out after 90s. In production timeout happens after 20min, and yet still regularly occurs.
curl --max-time 90 \ -X POST "https://***.openai.azure.com/openai/responses?api-version=2025-03-01-preview" \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $AZURE_API_KEY" \ -d '{ "model": "gpt-4.1", "input": [ { "role": "user", "content": "I am going to Paris, what should I see?" } ] }' curl: (28) Operation timed out after 90006 milliseconds with 0 bytes received
Azure
Azure
Eine Cloud Computing-Plattform und -Infrastruktur für die Erstellung, Bereitstellung und Verwaltung von Anwendungen und Diensten über ein weltweites Netzwerk aus Rechenzentren, die von Microsoft verwaltetet werden.
Anmelden, um zu antworten