How to call azure openai API on own data with python?

Parth Bhavsar 20

i want to call the azure openai API from python and get the chat working on my own data which is fetched from the index from the cognitive search of azure

problem is i am able to get the expected answer on the webapp generated from the openai console but not getting the same response in the API call from python or REST call

ajkuma 26,136 Reputation points Microsoft Employee

2023-09-14T19:24:26.67+00:00

Based on your issue description, I understand you're experiencing a discrepancy between the responses you receive from the OpenAI GPT-3 API in the Azure OpenAI console web app and the responses you get when making API calls from Python or via REST.

While I'm checking on this, if you haven't done this already so, please check your API Parameters: Ensure that you are passing the same input data [prompt or messages] and parameters (e.g., temperature, max tokens) to the API in your Python code as you are in the OpenAI console web app. Also, validate the API endpoint that you are using , and the authentication headers (API key) for correctness.

Kindly also share the Azure doc that you are referring for the steps.
ajkuma 26,136 Reputation points Microsoft Employee

2023-09-15T08:58:32.61+00:00

@Parth Bhavsar ,To benefit the community, please click Accept Answer - it will help community find the answers quicker.
Parth Bhavsar 20 Reputation points

2023-09-15T09:16:13.9066667+00:00

Thanks for the answer ajkuma, but do we have any way to use the openai library to do the same thing with help of chat completions ?
ajkuma 26,136 Reputation points Microsoft Employee

2023-09-19T04:10:49.0966667+00:00

Thanks for the follow-up. We need more info on your requirement, while OpenAI and Azure OpenAI Service rely on a common Python client library, there are small changes you need to make to your code in order to swap back and forth between endpoints. You may checkout keyword argument sample here for completions.

Are you asking if there is a library version of OnYourData functionality, so you don't have to construct the HTTP request manually? The OpenAI library doesn't currently provide this functionality.

Accepted answer

ajkuma 26,136 Reputation points Microsoft Employee

2023-09-15T04:24:37.29+00:00

@Parth Bhavsar ,

Following-up, just to clarify, are receiving an error response or is it just the quality of the result isn't as good?

A good reference is the Python code that generates the HTTP request for the webapp: https://github.com/microsoft/sample-app-aoai-chatGPT/blob/main/app.py#L162 - You may compare that with your code to understand any discrepancy.
Please sign in to rate this answer.

1 person found this answer helpful.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How to call azure openai API on own data with python?

0 additional answers

Your answer