Why is there mismatch between the json output supported models in practice and in documentation?

Question

Why is there mismatch between the json output supported models in practice and in documentation?

Debjit Kar 0

In documentation here, gpt-4o-mini ver 2024-07-18 is supposed to support json output.
On ai foundry, the only available version for deployment is the gpt-4o-mini ver 2024-07-18 in every region, the tag being "gpt-4o-mini".
But this version doesn't support json output when requested from api. The error message mentions that "response_format value as json_schema is enabled only for api versions 2024-08-01-preview and later".
However, this version isn't available for deployment on azure foundry.
So how can I get guaranteed json output from gpt-4o-mini deployed on azure foundry?

1 answer

Your answer

Answer 1

Saideep Anchuri 9,425 Microsoft External Staff Moderator

Hi Debjit Kar

The version of the gpt-4o-mini model you're using (2024-07-18) doesn't support JSON output, as the error message indicates. The documentation says that JSON output is only available for API versions 2024-08-01-preview and later. Since this version isn't available on Azure Foundry yet, you can't get JSON output from your current model version. To get JSON output, you'll need to wait for a compatible version to be available or check for updates from Azure What'snew.

Kindly refer below link: Howto use JSON mode

gpt-4o

Thank You.

Saideep Anchuri 9,425 Reputation points Microsoft External Staff Moderator

2025-03-03T03:16:02.31+00:00

Hi Debjit Kar

Following up to see if the above answer was helpful.

Thank You.
Debjit Kar 0 Reputation points

2025-03-03T05:28:58.77+00:00

Hey Saideep, thanks a lot for replying.
The documentation here suggests that 2024-07-18 is supported.

Hence the confusion.
Saideep Anchuri 9,425 Reputation points Microsoft External Staff Moderator

2025-03-03T08:56:58.93+00:00

Hi Debjit Kar

To make sure there’s no confusion around the mention of "2024-07-18" in the documentation, try searching for any context that mentions features, version updates, or compatibility specifics. Ensure that the documentation you're referencing is the most up-to-date version. Sometimes older versions can lead to confusion.

If the issue persists, please create a support ticket.

Thank You.
Saideep Anchuri 9,425 Reputation points Microsoft External Staff Moderator

2025-03-04T03:52:22.59+00:00

Hi Debjit Kar

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.

Thank You.

Share via

Why is there mismatch between the json output supported models in practice and in documentation?

1 answer

Your answer