parallel function calling is not available in Prompt Flow in Azure AI Studio?

Zhao, Lun 0 Reputation points
2024-10-08T03:57:11.3033333+00:00

I am trying to use parallel function calling in Prompt Flow, then deploy it to an endpoint. To use parallel one, Azure AI Service provide a new pair parameter "tools & tool_choice". But it is still not supported in Azure AI Studio, there is only a pair of "functions & function_call" parameters provided. I searched and find that the open-source prompt flow has supported this feature, but it is not available when using prompt flow in Azure AI Studio. Is there any plan to update this feature in the future?

User's image

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,604 questions
{count} votes

1 answer

Sort by: Most helpful
  1. AshokPeddakotla-MSFT 35,971 Reputation points Moderator
    2024-10-18T14:12:56.0333333+00:00

    I am trying to use parallel function calling in Prompt Flow, then deploy it to an endpoint. To use parallel one, Azure AI Service provide a new pair parameter "tools & tool_choice". But it is still not supported in Azure AI Studio, there is only a pair of "functions & function_call" parameters provided. I searched and find that the open-source prompt flow has supported this feature, but it is not available when using prompt flow in Azure AI Studio.

    Sincere apologies for the delayed response.

    I checked further and found that The functions and function_call parameters have been deprecated with the release of the 2023-12-01-preview version of the API. The replacement for functions is the tools parameter. The replacement for function_call is the tool_choice parameter.

    Regarding the ETA, There is no exact ETA, kindly open an issue here for further assistance.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.