Error when custom data is added to Azure OpenAI Service

Schukys, Jovan 0 Reputation points
2023-07-31T09:14:37.87+00:00

I receive the following error when adding my custom data which is a .txt file (it doesn't matter whether I add it via Azure Cognitive Search, Azure Blob Storage, or File Upload):

error

The error as text:
Error
Server disconnected
LLM call failed for chat completion endpoint. Please set OAIGenerationConfig(is_chat=True)

I stumbled upon a similar thread which advises to remove any underscores from the deployment name of the OpenAI model. Unfortunately that does not solve my issue, the deployment name doesn't contain any underscores.

After removing the Data Source, everything works fine again and the bot responds to my queries.

I am using an Azure OpenAI Service with a gpt-35-turbo deployment, which has the following details:
Version: 0301, Deployment Type: Standard, Capacity: 120K TPM

Any advice is appreciated!

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,623 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Konstantinos Passadis 19,376 Reputation points MVP
    2023-07-31T11:47:07.34+00:00

    ans1.txt

    Hello @Schukys, Jovan

    Welcome to Microsoft QnA!

    I see your issue is with Uploading your Data to Open AI

    Allow me to ask some things , may seem obvious but please clarify as much as possible;

    Do you have the Cognitive Services OpenAI Contributor Role ( or User) in the OpenaI Resource ?

    User's image

    Can you try with the Data i am providing ? Look attachement

    Let me know how it went !


    I hope this helps!

    Kindly mark the answer as Accepted and Upvote in case it helped!

    Regards


  2. Schukys, Jovan 0 Reputation points
    2023-07-31T12:43:53.6033333+00:00

    Hey @Konstantinos Passadis ,

    somebody suggested to redeploy the OpenAI Resource to a different region and see whether it works - I had them deployed to West Europe and switched to East US, which indeed does work. I will use that for now, thank you very much for your help.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.