Azure OpenAI on your data API access returns Internal Server Error

Question

Azure OpenAI on your data API access returns Internal Server Error

https://learn.microsoft.com/en-us/azure/cognitive-services/openai/reference#completions-extensions

https://github.com/Azure/azure-rest-api-specs/blob/c7d8f2eade1f9192dc07d7ce70c83e44dce6d922/specification/cognitiveservices/data-plane/AzureOpenAI/inference/preview/2023-06-01-preview/inference.json#L1138

I tried to use azure openai rest api by seeing sample parameter above.

However, requests returned following error.

I have no idea how to resolve.

{"error":{"code":"InternalServerError","message":"Backend returned unexpected response. Please contact Microsoft for help."}}

AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2023-06-23T05:11:03.8533333+00:00

システム管理者(検証環境) Greetings & welcome to Microsoft Q&A forum!

Could you confirm which region you are using? Also, check the Azure Portal service health and see if there is any info related to this?

Please make sure you are using correct API endpoint and API key

Can you re-try the request again? This could be a transient failure and retrying after sometime may result in a successful response.
システム管理者(検証環境) 5 Reputation points

2023-06-23T10:00:19.5533333+00:00

Thanks for reply.
システム管理者(検証環境) 5 Reputation points

2023-06-23T10:06:18.95+00:00

thanks for reply.

my coginitive search instance shows West US 2 region.

same error still shows up continuously...

api key and endpoint have no problem because i checked many times...
vijay sai mutyala 30 Reputation points

2023-07-11T12:29:49.98+00:00

I was facing a similar issue and modifying the ChatGpt-URL as above worked eliminate the 500 error. However, I'm now seeing the below error

Error message: {"error":{"code":"OperationNotSupported", "message":"The extensions chat completions operation must have at least one extension."}}

What does having at least one extension mean. Chat with data in the chat playground works well without any issues. Am I missing something ?
Gaurav Kumar Upadhyay 5 Reputation points

2023-07-12T19:16:36.58+00:00

Hi vijay sai mutyala,

I am facing the same error by following this article.

Have you discovered any solution around the same?
Dairton Lopes Martins Filho 0 Reputation points

2023-08-04T02:56:25.6366667+00:00

Hi guys!

I am facing the same error too, did you find any solution?

thanks!

Pongwasin Wintakorn 5

For people who faced this "The extensions chat completions operation must have at least one extension" error. Apparently, the JSON from the studio has the wrong format. According to https://github.com/Azure/azure-rest-api-specs/blob/c7d8f2eade1f9192dc07d7ce70c83e44dce6d922/specification/cognitiveservices/data-plane/AzureOpenAI/inference/preview/2023-06-01-preview/inference.json#L1138

You need to change from three azure search field to dataSources field instead

{
2  "messages": [
3    {
4      "role": "system",
5      "content": "You are an AI assistant that helps people find information."
6    }
7  ],
8  "temperature": 0,
9  "top_p": 1,
10  "frequency_penalty": 0,
11  "presence_penalty": 0,
12  "max_tokens": 800,
13  "stop": null,
14  "azureSearchEndpoint": "xxxxxx", remove this
15  "azureSearchKey": "***", remove this
16  "azureSearchIndexName": "xx" remove this
17}


          "dataSources": [
            {
              "type": "AzureCognitiveSearch",
              "parameters": {
                "endpoint": "https://mysearchexample.search.windows.net",
                "key": "***(admin key)",
                "indexName": "my-chunk-index",
                "fieldsMapping": {
                  "titleField": "productName",
                  "urlField": "productUrl",
                  "filepathField": "productFilePath",
                  "contentFields": [
                    "productDescription"
                  ],
                  "contentFieldsSeparator": "\n"
                },
                "topNDocuments": 5,
                "queryType": "semantic",
                "semanticConfiguration": "defaultConfiguration",
                "inScope": true,
                "roleInformation": "roleInformation"
              }
            }}

3 answers

Your answer

AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2023-06-23T05:11:03.8533333+00:00

システム管理者(検証環境) Greetings & welcome to Microsoft Q&A forum!

Could you confirm which region you are using? Also, check the Azure Portal service health and see if there is any info related to this?

Please make sure you are using correct API endpoint and API key

Can you re-try the request again? This could be a transient failure and retrying after sometime may result in a successful response.
システム管理者(検証環境) 5 Reputation points

2023-06-23T10:00:19.5533333+00:00

Thanks for reply.
システム管理者(検証環境) 5 Reputation points

2023-06-23T10:06:18.95+00:00

thanks for reply.

my coginitive search instance shows West US 2 region.

same error still shows up continuously...

api key and endpoint have no problem because i checked many times...
vijay sai mutyala 30 Reputation points

2023-07-11T12:29:49.98+00:00

I was facing a similar issue and modifying the ChatGpt-URL as above worked eliminate the 500 error. However, I'm now seeing the below error

Error message: {"error":{"code":"OperationNotSupported", "message":"The extensions chat completions operation must have at least one extension."}}

What does having at least one extension mean. Chat with data in the chat playground works well without any issues. Am I missing something ?
Gaurav Kumar Upadhyay 5 Reputation points

2023-07-12T19:16:36.58+00:00

Hi vijay sai mutyala,

I am facing the same error by following this article.

Have you discovered any solution around the same?
Dairton Lopes Martins Filho 0 Reputation points

2023-08-04T02:56:25.6366667+00:00

Hi guys!

I am facing the same error too, did you find any solution?

thanks!
Pongwasin Wintakorn 5 Reputation points

2023-09-29T08:15:28.0166667+00:00

For people who faced this "The extensions chat completions operation must have at least one extension" error. Apparently, the JSON from the studio has the wrong format. According to https://github.com/Azure/azure-rest-api-specs/blob/c7d8f2eade1f9192dc07d7ce70c83e44dce6d922/specification/cognitiveservices/data-plane/AzureOpenAI/inference/preview/2023-06-01-preview/inference.json#L1138

You need to change from three azure search field to dataSources field instead

{ 2 "messages": [ 3 { 4 "role": "system", 5 "content": "You are an AI assistant that helps people find information." 6 } 7 ], 8 "temperature": 0, 9 "top_p": 1, 10 "frequency_penalty": 0, 11 "presence_penalty": 0, 12 "max_tokens": 800, 13 "stop": null, 14 "azureSearchEndpoint": "xxxxxx", remove this 15 "azureSearchKey": "***", remove this 16 "azureSearchIndexName": "xx" remove this 17}

"dataSources": [ { "type": "AzureCognitiveSearch", "parameters": { "endpoint": "https://mysearchexample.search.windows.net", "key": "***(admin key)", "indexName": "my-chunk-index", "fieldsMapping": { "titleField": "productName", "urlField": "productUrl", "filepathField": "productFilePath", "contentFields": [ "productDescription" ], "contentFieldsSeparator": "\n" }, "topNDocuments": 5, "queryType": "semantic", "semanticConfiguration": "defaultConfiguration", "inScope": true, "roleInformation": "roleInformation" } }}

Answer 1

システム管理者(検証環境) 5

Solved

-H "chatgpt_url: YOUR_RESOURCE_URL" \

It shoud be like

https://XXXXX.openai.azure.com/openai/deployments/XXXXX/chat/completions?api-version=2023-03-15-preview"

Will be worked

vijay sai mutyala 30 Reputation points

2023-07-11T12:28:17.5366667+00:00

I was facing a similar issue and modifying the ChatGpt-URL as above worked eliminate the 500 error. However, I'm now seeing the below error

Error message: {"error":{"code":"OperationNotSupported", "message":"The extensions chat completions operation must have at least one extension."}}

What does having at least one extension mean. Chat with data in the chat playground works well without any issues. Am I missing something ?
Antonius Wido 0 Reputation points

2023-11-13T07:07:09.65+00:00
this is what I do and works (test date 13 nov 2023)

use extensions/chat/completions
https://XXXXX.openai.azure.com/openai/deployments/XXXXX/extensions/chat/completions?api-version=2023-03-15-preview"

I see someone use this https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference/preview/2023-07-01-preview/inference.json#L1116
check line 1115 to 1138. I only use endpoint, key and indexName

Answer 2

Dairton Lopes Martins Filho 0

Hi @vijay sai mutyala !

I am facing the same problem. Did you find a solution?

Thanks!

Answer 3

Nicolas Robert 20

Sorry / Wrong topic, cannot delete answer

Share via

Azure OpenAI on your data API access returns Internal Server Error

3 answers

Your answer