Azure OpenAI Internal Server Error Failed to create deployments

Charles Elwood 106 MVP

User's image

I have trained and deployed 2 ada and 1 curie based fined tuned models.
Today I created a new find tuned model based on curie, ad am seeing internal server errors. I don't see any more details about the server error other than what is shown in the screenshot. Tried deleting all of the fine tuned deployments and the other curie based fine tuned model. Let me know if I can debug further or I should start a completely new training?

romungi-MSFT 44,771 Reputation points Microsoft Employee

2023-02-23T07:38:45.1866667+00:00

Charles Elwood The max number of fine-tuned deployments is currently 2 and if you have atleast 2 already then, I would assume that could be the probable cause. If this is the case, you can request increase through this form.

https://aka.ms/oai/quotaincrease

If you do not have a deployment already and the error is still seen, then you might have to report the error through support for the service team to take a look at the internal error.
Charles Elwood 106 Reputation points MVP

2023-02-23T13:39:19.6866667+00:00

I only have one model deployed, and zero fine tune models 😭 I'll submit a ticket.
Charles Elwood 106 Reputation points MVP

2023-02-23T13:40:53.0233333+00:00

@romungi-MSFT

I currently have zero fine tuned models deployed....I will submit a ticket.
Tien LE 0 Reputation points

2023-03-17T13:29:44.6433333+00:00

@Charles Elwood Did you have a solution for the above issue?

We now have the same error as described as above :(

Thanks in advance for your feedback.
Joel Borellis (gametolearn) 195 Reputation points

2023-03-26T15:00:12.48+00:00

@Charles Elwood have you been able to resolve this issue? I'm struggling with the same problem. I believe the core of the issue is in the uploading of .jsonl file that would be used for the fine tune. For a test I created a deployment in the East and had not issues uploading a .jsonl file BUT East does not support fine-tuning so I'm left with trying to get my file to upload in Central and it's just not working. I'm going to try Europe this morning.

1 answer

Charles Elwood 106 Reputation points MVP

2023-03-26T22:53:30.0333333+00:00

I worked with the Microsoft support team and the issue went away by itself but it was tagged as a "transient" issue and was closed. The day before the issue resolved itself, I did go into my deployments that were originally deployed and had taken up the two spots and generated the error when I added the third deployment. I deleted the models that were previously deployed and I'm wondering if that fixed the issue.
Please sign in to rate this answer.

1 person found this answer helpful.
Joel Borellis (gametolearn) 195 Reputation points

2023-03-27T15:07:22.2866667+00:00

Thanks @Charles Elwood I deleted and redeployed and all is good.

Joel Borellis (gametolearn) 195 Reputation points

2023-03-27T20:59:58.2066667+00:00

@Charles Elwood were you required to have a validation .jsonl file or were you able to create a fine tune with just a training .jsonl. I'm able to upload training file but still erroring out when trying to create the fine tune and I'm wondering if it's because I'm skipping the validation file. Thanks!
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure OpenAI Internal Server Error Failed to create deployments

1 answer

Your answer