Hi @Mason,
Could you please review the JSONL file for any unsupported parameters and share the findings in a private message if possible?
However, since the o3-mini
model requires API version 2024-12-01-preview
or later, issues may arise if Prompt Flow is using an earlier API version by default. This is likely the cause of the error you're encountering.
As a workaround, you can use the default JSONL format with a model that is already confirmed to work within your environment (e.g., gpt-4o
).
{"custom_id": "task-0", "method": "POST", "url": "/chat/completions", "body": {"model": "REPLACE-WITH-MODEL-DEPLOYMENT-NAME", "messages": [{"role": "system", "content": "You are an AI assistant that helps people find information."}, {"role": "user", "content": "When was Microsoft founded?"}]}}
{"custom_id": "task-1", "method": "POST", "url": "/chat/completions", "body": {"model": "REPLACE-WITH-MODEL-DEPLOYMENT-NAME", "messages": [{"role": "system", "content": "You are an AI assistant that helps people find information."}, {"role": "user", "content": "When was the first XBOX released?"}]}}
{"custom_id": "task-2", "method": "POST", "url": "/chat/completions", "body": {"model": "REPLACE-WITH-MODEL-DEPLOYMENT-NAME", "messages": [{"role": "system", "content": "You are an AI assistant that helps people find information."}, {"role": "user", "content": "What is Altair Basic?"}]}}
Kindly refer this Preparing your batch file.
Also, this is the reference thread for similar issue https://learn.microsoft.com/en-us/answers/questions/2260401/azure-batch-openai-not-working-with-o3-mini-bad-re
I Hope this helps. Do let me know if you have any further queries.
If this answers your query, please do click Accept Answer
and Yes
for was this answer helpful.
Thank you!