Failed to delete deployment ... Internal Server Error

Question

I deployed a fine-tuned model using Azure Open AI service early today in the region of EAST US2, but now I couldn't delete the deployment with an error message "Failed to delete deployment ... Internal Server Error." Is the issue still there? Since the deployment is not able to be deleted, I wonder if it is continuously consuming my wallet?

Answer 1

Yes, it will consume your wallet if still exists.

Try this to delete: Deployments - Delete - REST API (Azure Azure AI Services) | Microsoft Learn

You can mark it 'Accept Answer' and 'Upvote' if this helped you

Regards,

Abiola

Answer 2

The fine-tuned model was able to be deleted. Not sure if it was because the server issue.

Answer 3

I'm glad that your issue is resolved and thank you for confirming as well. This could be a transient failure.

Since the Microsoft Q&A community has a policy that the question author cannot accept their own answer, they can only accept answers by others, I'll repost your solution in case you'd like to Accept the answer.

Error Message:

Solution:

This could be a transient failure in a particular region.

I deployed a fine-tuned model using Azure Open AI service early today in the region of EAST US2, but now I couldn't delete the deployment with an error message "Failed to delete deployment ... Internal Server Error." Is the issue still there? Since the deployment is not able to be deleted, I wonder if it is continuously consuming my wallet?

You can't delete a custom model if it has an existing deployment. You must first delete your model deployment before you can delete your custom model.

To give more context, After you deploy a customized model, if at any time the deployment remains inactive for greater than fifteen (15) days, the deployment is deleted. The deployment of a customized model is inactive if the model was deployed more than fifteen (15) days ago and no completions or chat completions calls were made to it during a continuous 15-day period.

The deletion of an inactive deployment doesn't delete or affect the underlying customized model, and the customized model can be redeployed at any time. As described in Azure OpenAI Service pricing, each customized (fine-tuned) model that's deployed incurs an hourly hosting cost regardless of whether completions or chat completions calls are being made to the model. To learn more about planning and managing costs with Azure OpenAI, refer to the guidance in Plan to manage costs for Azure OpenAI Service.

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.