Share via

Structured Output in gpt-4o-mini

Michael Wang 45 Reputation points
2024-08-23T16:44:08.53+00:00

I was attempting to test the structured outputs feature from this article, specifically the MathReasoning example:
https://platform.openai.com/docs/guides/structured-outputs/introduction

I was using the gpt-4o-mini deployment from Azure AI Studio and constantly getting the following error:

Error code: 400 - {'error': {'message': "Invalid parameter: 'response_format' must be one of 'json_object', 'text'.", 'type': 'invalid_request_error', 'param': 'response_format', 'code': None}}

I searched online and found someone that said that Azure Studio doesn't support this feature yet (including json schema) and I was wondering if this is true or not.

Foundry Tools
Foundry Tools

Formerly known as Azure AI Services or Azure Cognitive Services is a unified collection of prebuilt AI capabilities within the Microsoft Foundry platform

10 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Martin Zachoszcz 45 Reputation points
    2024-10-09T17:26:15.1566667+00:00

    I find this extremely weird that this isn't actually working, because the model that is deploy in Azure: GPT-4o-mini (2024-07-18) should actually have this functionality based on the documentation from openAI:
    https://platform.openai.com/docs/guides/structured-outputs/supported-models

    But somehow it does not work. It works for the large GPT-4o (2024-08-06) model though.

    Can someone from Microsoft clarify what's going on here and when we can expect support for the mini model?

    Was this answer helpful?

    5 people found this answer helpful.
  2. Kelvin Confesor 15 Reputation points
    2024-11-10T17:41:38.61+00:00

    Well, this is not looking good, I understand that MS needs some time to sync with OAI but it's been a while now, unfortunately for us this feature is critical, we'll have to switch to OpenAI endpoints until this problem is solved.

    Was this answer helpful?

    3 people found this answer helpful.
    0 comments
  3. Torsten 15 Reputation points
    2024-10-02T10:41:45.9766667+00:00

    Same question here, any updates regarding the ETA for structured outputs in gpt-4o-mini in Azure OpenAI?

    Thanks!

    Was this answer helpful?

    3 people found this answer helpful.
  4. Andrey Lukin 10 Reputation points
    2024-09-27T18:29:54.8066667+00:00

    Hi, any updates on the ETA for structured output in azure?

    TIA!

    Was this answer helpful?

    2 people found this answer helpful.
    0 comments
  5. ChrisH 86 Reputation points
    2024-09-17T19:34:16.9533333+00:00

    Any updates on an ETA for mini?

    Was this answer helpful?

    2 people found this answer helpful.

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.