How to Use Tools/Function Calling in Azure OpenAI?

micos 0

Hello everyone,

I've been using the Azure OpenAI service and encountered an issue. After adding the parameters tools: tools, tool_choice: "auto" in the request, the API returns a 404 error. The model I'm using is gpt4-turbo-1106-Preview. When I remove these two parameters, the API response is normal.

I am using the openai 0.9.4 node.js library. Everything works fine without the tools parameter, but as soon as I add it, I get a 404 error. Can anyone advise on how to properly support the tools/function calling feature in Azure OpenAI?

User's image

I did an experiment using the Azure OpenAI library files, and with this approach, the call works correctly. Does this mean that when using Azure OpenAI tools, one must use Azure's own library? Does the official OpenAI library support Azure OpenAI tools features? Can I enable support by updating from OpenAI 0.9.4 to a newer version?

Tested using the Azure OpenAI JavaScript library: https://www.npmjs.com/package/@azure/openai (Azure OpenAI client library for JavaScript)

AshokPeddakotla-MSFT 29,986 Reputation points

2024-01-08T09:32:46.42+00:00

micos Greetings & Welcome to Microsoft Q&A forum!

Did you check How to use function calling with Azure OpenAI Service (Preview) already?

Function calling is available in the 2023-07-01-preview API version and works with version 0613 of gpt-35-turbo, gpt-35-turbo-16k, gpt-4, and gpt-4-32k.

Are you trying to use the embeddings operation with the gpt-4-32k model?
AshokPeddakotla-MSFT 29,986 Reputation points

2024-01-10T02:18:33.03+00:00

micos Just checking to see if you had a chance to review my response.

Do let us know if you need any further help.

Share via

How to Use Tools/Function Calling in Azure OpenAI?