Our Azure OpenAI deployment worked fine in december 2023, stopped working a couple weeks ago

Tobias Müller Andersen 0

Error is "Error in input stream". Since january this year there has been 10 threads over at the OpenAI forum about this error message suddenly appearing in OpenaI projects that was working fine before: https://community.openai.com/search?q=Error%20in%20input%20stream%20after%3A2024-01-01 If i try to open a support request in Microsoft Azure under "Help + support" --> "New support request" there's no options to create a support ticket related to Azure OpenAI. Where can i start to debug this in Azure? It seems like OpenAI has issues and there's not something i can control, but i should at least be able to get a proper response from OpenAI when it is down. This page is not accurate: https://status.openai.com/

Saurabh Sharma 23,791 Reputation points Microsoft Employee

2024-01-25T15:39:15.2266667+00:00
Hi @Tobias Müller Andersen

Welcome to Microsoft Q&A! Thanks for posting the question.

The post you have shared is related to OpenAI issues. Are you seeing similar issues on Azure Open AI service?

Can you please provide more details -

Are you getting this error on Azure Open AI Playground

Any code snippet which you are using to get the open ai response?

Thanks

Saurabh

Jonas Schie Olsen 5

Hi I am following up for Tobias. We are getting this error in our web app from time to time. We are getting it on a pretty standard streamChatCompletion call with a azureCognitiveSearch extension. The query work find as Tobias said, until it suddenly didn't. Sorry for the horrible formatting of the code snippet, i couldnt get the field to cooperate.

const responses = await client.streamChatCompletions( 
				AOAIDeploymentIdConfig,
				[{role: 'system',content: systemMsg},
				{role: 'user',content: queryField}],                 
				{azureExtensionOptions: {extensions: 
					[azureCognitiveSearchOptions],},
				maxTokens,},             )              
const responseArray: ChatCompletions[] = []              
// Iterate through the async iterable and push each element to the array           
for await (const response of responses) {                 responseArray.push(response)             }              
// Set the response chunks to the array             
setResponseChunks(responseArray)         } 
catch (error) 
{        
     console.error('Error sending data:', error)
} 
finally 
{setIsLoading(false) // Set loading state to false, whether successful or not         
}     }

Saurabh Sharma 23,791 Reputation points Microsoft Employee

2024-01-29T21:04:33+00:00

@Tobias Müller Andersen Jonas Schie Olsen, Thanks for sharing the code, I am looking into it and get back to you. Thanks.
Synth 0 Reputation points

2024-02-19T20:19:30.8533333+00:00

Hello we do have exactly the same problem with our OpenAI Instances. Our code bases did not change, but suddenly it doesn't work anymore. The same error as Jonas.

Share via

Our Azure OpenAI deployment worked fine in december 2023, stopped working a couple weeks ago