OpenAI InternalServerError: Error code: 500 when creating multiple batch jobs

Question

for batch_file_id in batch_file_ids:

    batch_response = openai_client.batches.create(
        input_file_id=batch_file_id,
        endpoint="/chat/completions",
        completion_window="24h",
        metadata={"description": f"{run_id}"},
    )

Error:
InternalServerError: Error code: 500 - {'error': {'code': 'ServiceError', 'severity': None, 'message': 'InternalServerError', 'messageFormat': None, 'messageParameters': None, 'referenceCode': None, 'detailsUri': None, 'target': None, 'details': [], 'innerError': None, 'debugInfo': None, 'additionalInfo': None}, 'correlation': {'operation': '7448512eb3c979d9148469330b971139', 'request': '672634cdb2ba5a8f'}, 'environment': 'swedencentral', 'location': 'swedencentral', 'time': '2024-08-26T08:46:26.5564978+00:00', 'componentName': 'managed-batch-inference', 'statusCode': 500}

It worked fine until 2024-08-23. Now I can only process one batch a time. If I try to create a second batch I get error 500. Something has changed but what?

Answer 1

Hello @Mikko Ritala

Thanks for reaching out to us, this issue should be resolved right now, please have a try.

Let us know if you need more help or still blocked. We are happy to help further.

Regards,

Yutong

-Please kindly accept the answer if you feel helpful to support the community, thanks a lot.