What's the cost of storing fine-tuned OpenAI models without using or deploying them?

Question

I am simply storing my fine-tuned model in Azure OpenAI Service without deploying or accessing them. I cannot find the cost associated with this (the platform says cost analysis is not available for my subscription type).

Answer 1

Hi @Janos Perczel
Welcome to the Microsoft Q&A Platform! Thank you for asking your question here. 

You can't seem to figure out the detailed cost of storing your optimized model because your current Azure subscription doesn't support cost analysis features. This is common for certain types of subscriptions, such as free trials or low-cost plans. 

If you’re open to it, moving up to a Pay-As-You-Go or higher tier subscription will give you more detailed analysis of payments and expenses. 

You can still view all charges in the Billing section of the Azure portal. This will give you a general idea of how much you are being charged. 

 The Azure Pricing Calculator | Microsoft Azure can help you calculate what it will cost you to store your image. 

 If you need specific information, feel free to contact Azure support. You can be given a breakdown of your expenses based on your account. 

If you are comfortable using command line tools, the Azure CLI is another way to track your usage and spend. 

For reference, please review this documentation:-

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/fine-tuning?pivots=programming-language-studio&tabs=azure-openai%2Cturbo%2Cpython-new

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/manage-costs#understand-the-azure-openai-full-billing-model

If you have any further queries, do let us know

Answer 2

Short answer: There is no cost to having fine-tuned models in your account as long as they are not deployed.

I was able to find how you can view usage info even for 'sponsored' subscriptions for which spend management is not available.

1. Go to:

https://www.microsoftazuresponsorships.com/Usage

2. Then click on the 'Download' button on the far right:

3. Download the CSV file with all the spend data.
4. Analyze the spend.