Structured Output in gpt-4o-mini

Michael Wang 35 Reputation points
2024-08-23T16:44:08.53+00:00

I was attempting to test the structured outputs feature from this article, specifically the MathReasoning example:
https://platform.openai.com/docs/guides/structured-outputs/introduction

I was using the gpt-4o-mini deployment from Azure AI Studio and constantly getting the following error:

Error code: 400 - {'error': {'message': "Invalid parameter: 'response_format' must be one of 'json_object', 'text'.", 'type': 'invalid_request_error', 'param': 'response_format', 'code': None}}

I searched online and found someone that said that Azure Studio doesn't support this feature yet (including json schema) and I was wondering if this is true or not.

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,895 questions
{count} votes

9 answers

Sort by: Most helpful
  1. Martin Zachoszcz 20 Reputation points
    2024-10-09T17:26:15.1566667+00:00

    I find this extremely weird that this isn't actually working, because the model that is deploy in Azure: GPT-4o-mini (2024-07-18) should actually have this functionality based on the documentation from openAI:
    https://platform.openai.com/docs/guides/structured-outputs/supported-models

    But somehow it does not work. It works for the large GPT-4o (2024-08-06) model though.

    Can someone from Microsoft clarify what's going on here and when we can expect support for the mini model?

    4 people found this answer helpful.

  2. Torsten 10 Reputation points
    2024-10-02T10:41:45.9766667+00:00

    Same question here, any updates regarding the ETA for structured outputs in gpt-4o-mini in Azure OpenAI?

    Thanks!

    2 people found this answer helpful.

  3. ChrisH 46 Reputation points
    2024-09-17T19:34:16.9533333+00:00

    Any updates on an ETA for mini?

    1 person found this answer helpful.

  4. Andrey Lukin 5 Reputation points
    2024-09-27T18:29:54.8066667+00:00

    Hi, any updates on the ETA for structured output in azure?

    TIA!

    1 person found this answer helpful.
    0 comments No comments

  5. Gyan Veda 15 Reputation points
    2024-09-30T14:52:04.2933333+00:00

    Any updates for Structured Outputs for mini? It'd be super helpful, thank you!

    1 person found this answer helpful.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.