Does OpenAI Batch Processing support Structured output?

Question

Does Azure OpenAI GlobalBatch GPT-4o deployment supports "Structured output"? With response_format="json_schema" (and valid schema) it returns empty output (Sweden Central Azure regione).
Without structured output - it works fine, and GlobalStandard 4o model (same version: 2024-08-06) produces the structured output as expected.

I tried it with a request that worked fine with OpenAI Batch Structured output near the end of this conversation, and on Azure it returns an empty file. So, does it mean that it is not supported on Azure, yet? Or is it some bug of me/Azure?

Request that worked with OpenAI and returns an empty file on Azure:

{"custom_id": "request-1", "method": "POST", "url": "/chat/completions", "body": {"model": "gpt-4o-batch", "messages": [{"role": "system", "content": "You are a helpful math tutor. Guide the user through the solution step by step."}, {"role": "user", "content": "how can I solve 8x + 7 = -23"}], "max_tokens": 4096, "response_format": {"type": "json_schema", "json_schema": {"name": "math_response", "schema": {"type": "object", "properties": {"steps": {"type": "array", "items": {"type": "object", "properties": {"explanation": {"type": "string"}, "output": {"type": "string"}}, "required": ["explanation", "output"], "additionalProperties": false}}, "final_answer": {"type": "string"}}, "required": ["steps", "final_answer"], "additionalProperties": false}, "strict": true}}}}

Same request without the response_format or with 'json_object' format works fine.

I am using a deployment in the Sweden Central region, if it matters.

Answer 1

Structured outputs is now available for global batch deployments as long as you use 2024-08-01-preview