Using own data in Azure Open AI via the REST API

Question

Using own data in Azure Open AI via the REST API

Henk Terblanche 55

I have created a deployment and loaded my own data (number of html files from a knowledge base). When asking a question related to the data in the Chat Playground / a Web App deployed from Azure OpenAI Studio the answer is related to my own data. However when I use the Azure OpenAI REST API (using the keys and end-point supplied for my deployment) it returns a generic answer and not based on my data. Does the REST API support user data at this stage or have I made a mistake in my configuration?

Gabriel Susai 35 Reputation points

2024-03-14T14:51:48.2933333+00:00

Hi, I am facing the below error "Failed to get managed identity token." while testing the code locally using the sample app using your own data.

Error Error code: 400 - {'error': {'requestid': 'aae728a0-799f-49de-8ade-c1e51a5bbbbc', 'code': 400, 'message': 'Failed to get managed identity token. Response: {"error":{"code":"ManagedIdentityIsNotEnabled","message":"Managed Identity (MI) is not set for this account while the encryption key source is 'Microsoft.KeyVault', customer managed storage or Network Security Perimeter is used."}}'}}

Using AzureSearch Service with semantic search. I don't have any identify enabled at the storage or AI Search service.

Thanks

Accepted answer

1 additional answer

Your answer

Gabriel Susai 35 Reputation points

2024-03-14T14:51:48.2933333+00:00

Hi, I am facing the below error "Failed to get managed identity token." while testing the code locally using the sample app using your own data.

Error Error code: 400 - {'error': {'requestid': 'aae728a0-799f-49de-8ade-c1e51a5bbbbc', 'code': 400, 'message': 'Failed to get managed identity token. Response: {"error":{"code":"ManagedIdentityIsNotEnabled","message":"Managed Identity (MI) is not set for this account while the encryption key source is 'Microsoft.KeyVault', customer managed storage or Network Security Perimeter is used."}}'}}

Using AzureSearch Service with semantic search. I don't have any identify enabled at the storage or AI Search service.

Thanks

Answer 1

Charlie Wei 3,335

Hello @Henk Terblanche ,

If your answer on Chat Playground is related to your own data, the same applies when using Azure OpenAI REST API.

Suppose your data is stored on Azure AI Search, you can refer to the request examples in this document.

curl -i -X POST YOUR_RESOURCE_NAME/openai/deployments/YOUR_DEPLOYMENT_NAME/extensions/chat/completions?api-version=2023-06-01-preview \
-H "Content-Type: application/json" \
-H "api-key: YOUR_API_KEY" \
-d \
'
{
    "temperature": 0,
    "max_tokens": 1000,
    "top_p": 1.0,
    "dataSources": [
        {
            "type": "AzureCognitiveSearch",
            "parameters": {
                "endpoint": "YOUR_AZURE_COGNITIVE_SEARCH_ENDPOINT",
                "key": "YOUR_AZURE_COGNITIVE_SEARCH_KEY",
                "indexName": "YOUR_AZURE_COGNITIVE_SEARCH_INDEX_NAME"
            }
        }
    ],
    "messages": [
        {
            "role": "user",
            "content": "What are the differences between Azure Machine Learning and Azure AI services?"
        }
    ]
}
'

Best regards,
Charlie

If you find my response helpful, please consider accepting this answer and voting 'yes' to support the community. Thank you!

Charlie Wei 3,335 Reputation points

2024-02-17T12:39:25.1566667+00:00

Hello @Henk Terblanche ,

Just checking in to see if above information was helpful. Please let us know if you would like further assistance.

Henk Terblanche 55

Thank you. I have tried your example. However now I am getting the following error:

{
    "error": {
        "requestid": "8fb3e45a-3fe6-4704-82fd-420298ac1f79",
        "code": 400,
        "message": "Failed to get managed identity token. Response: {\"error\":{\"code\":\"ManagedIdentityIsNotEnabled\",\"message\":\"Managed Identity (MI) is not set for this account while the encryption key source is 'Microsoft.KeyVault', customer managed storage or Network Security Perimeter is used.\"}}"
    }
}

However neither my storage account nor the search service has been configured to use identities? User's image

User's image

Henk Terblanche 55 Reputation points

2024-02-19T18:07:44.12+00:00

Does the YOUR_AZURE_COGNITIVE_SEARCH_KEY refer to the name of the Key added under API Access control on the Search Service?
Henk Terblanche 55 Reputation points

2024-02-19T18:21:57.5566667+00:00

I had to use the Admin key value in key - a query key did not work
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2024-02-21T02:06:54.01+00:00

Glad to here your issue is resolved.

Answer 2

Henk Terblanche Greetings & Welcome to Microsoft Q&A forum!

Does the REST API support user data at this stage or have I made a mistake in my configuration?

To answer your question, yes you can access Azure OpenAI on your data using a REST API or the web-based interface in the Azure OpenAI Studio

However when I use the Azure OpenAI REST API (using the keys and end-point supplied for my deployment) it returns a generic answer and not based on my data.

Make sure that you have correctly loaded your data into the deployment. You can check this by verifying that your data is visible in the Chat Playground or Web App

Did you try setting the inScope parameter?

You can refer to the Azure OpenAI Service REST API reference documentation for details on how to structure a request and receive a response.

Do let me know if that helps or have any further queries.

Share via

Using own data in Azure Open AI via the REST API

1 additional answer

Your answer