Azure OpenAI Studio 微调 gpt-4o 数据集包含图片时, 微调任务就会失败

Question

Azure OpenAI Studio 中微中 gpt-4o 模型, 当数据集重包含图片时, 微调任务失败。

微调时，数据集包含以下这种 image_url 类的多模态数据时, 微调任务就会失败

{ "messages": [ { "content": "1111", "role": "system" }, { "content": "你好", "role": "user" }, { "content": "这是什么", "role": "user" }, { "role": "user", "content": [{"type": "image_url","image_url": {"url": "https://img.test.com/111.png"}}]}, { "content": "这是xxxx", "role": "assistant" } ]}

微调任务ID: ftjob-4b62a514ea6a4c54952165231aaa5d2c

任务日志:

Training started (retry 2).
Retrying after failed attempt 2
Postprocessing started (retry 1).
Job failed. (attempt 2)
Training started (retry 1).
Preprocessing started (retry 1).
Retrying after failed attempt 1
Postprocessing started.