Error Encountered When Using Azure OpenAI API with Structured Outputs and Images

Question

Error Encountered When Using Azure OpenAI API with Structured Outputs and Images

Yash Worlikar 20

Encountering issues while making an Azure OpenAI call when setting the response format to structured outputs alongside sending an image. The API response returns the following error message:

{"error":{"code":"InternalServerError","message":"The service is temporarily unable to process your request. Please try again later."}}

Both structured outputs and image content work independently, but combining them results in this error.

AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2024-10-15T08:54:21.85+00:00

Yash Worlikar Greetings & Welcome to Microsoft Q&A forum!

Both structured outputs and image content work independently, but combining them results in this error.

Are you using Function calling? If yes, Structured outputs is not supported with parallel function calls. When using structured outputs set parallel_tool_calls to false.
Yash Worlikar 20 Reputation points

2024-10-15T09:43:15.4133333+00:00

No I am only using Structured outputs and image content together, nothing else.

Even the API responses for the above scenario are taking usually long (1-2 mins) before I get the above error response.
Yash Worlikar 20 Reputation points

2024-10-15T09:47:49.7533333+00:00

AshokPeddakotla-MSFT
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2024-10-16T11:16:28.0366667+00:00
Yash Worlikar I'm checking internally and update you as earliest with my findings whether it supports or not.

As mentioned here, there are some limitations.

Currently structured outputs is not supported on bring your own data scenario.

There is a known issue blocking structured outputs support for global batch.

Accepted answer

0 additional answers

Your answer

AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2024-10-15T08:54:21.85+00:00

Yash Worlikar Greetings & Welcome to Microsoft Q&A forum!

Both structured outputs and image content work independently, but combining them results in this error.

Are you using Function calling? If yes, Structured outputs is not supported with parallel function calls. When using structured outputs set parallel_tool_calls to false.
Yash Worlikar 20 Reputation points

2024-10-15T09:43:15.4133333+00:00

No I am only using Structured outputs and image content together, nothing else.

Even the API responses for the above scenario are taking usually long (1-2 mins) before I get the above error response.
Yash Worlikar 20 Reputation points

2024-10-15T09:47:49.7533333+00:00

AshokPeddakotla-MSFT
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2024-10-16T11:16:28.0366667+00:00

Yash Worlikar I'm checking internally and update you as earliest with my findings whether it supports or not.

As mentioned here, there are some limitations.

Currently structured outputs is not supported on bring your own data scenario.

There is a known issue blocking structured outputs support for global batch.

Answer 1

AshokPeddakotla-MSFT 35,971 Moderator

Yash Worlikar This issue has been resolved. As mentioned in my previous comments, there was an issue with blocking structured outputs support for global batch.

A Hotfix has been rolled out in the affected regions. Further communication will be sent to affected customers to confirm that the issue has been resolved and to provide any necessary updates.

Also, the page has been updated.

please check and update if you are still facing this issue.

Yash Worlikar 20 Reputation points

2024-10-24T05:45:32.0566667+00:00

Thanks, it's working now.

Although previously I wasn't using the Global batch deployment, just the Global Standard deployment for the chat completions API but it looks like hotfix fixed both
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2024-10-24T09:54:28.81+00:00

Glad to hear your issue is resolved and thanks for confirming.

Share via

Error Encountered When Using Azure OpenAI API with Structured Outputs and Images

0 additional answers

Your answer