Support for `"tool_choice": "required"` in Azure OpenAI service

Question

https://learn.microsoft.com/en-us/azure/ai-services/openai/reference doesn't yet support "tool_choice":"required" while it is already available in https://platform.openai.com/docs/api-reference/chat/create#chat-create-tool_choice

Answer 1

peter.kadlot Greetings & Welcome to Microsoft Q&A forum!

https://learn.microsoft.com/en-us/azure/ai-services/openai/reference doesn't yet support "tool_choice":"required" while it is already available in https://platform.openai.com/docs/api-reference/chat/create#chat-create-tool_choice

AFAIK, these features will be available in the next releases. We don't have any exact ETA which can be shared now.

I would suggest you, keep an eye on the What's new in Azure OpenAI Service for more updates.

Answer 2

@peter.kadlot

Openai offers two ways to customize the default behavior depending on your use case:

1. To force the model to always call one or more tools, you can set tool_choice: "required". The model will then select which tool to call. AzureOpenAI doesn't support this method.
2. To force the model to call only one specific function, you can set tool_choice: {"type": "file_search"}.

Use the second way, it worked for me.