Cost estimation of models

Question

Hi there,

I have one query. I am using Azure Open AI studio, there i can't be able to create a custom model. So i am using base models. Can you give me the cost estimation for each model. Also what's the type of fine-tuning used here?

Answer 1

@ird_infra For being able to create a custom model, you do not have the required Azure RBAC Role, addition to the regular role needed to manage the Azure OpenAI Resource itself.

The Cognitive Services OpenAI Contributor and Cognitive Services Contributor should give permission to do every action in Azure OpenAI Studio.

Do note that there are some differences in model availability by region and the pricing for each model can be found on the official pricing page for Azure OpenAI Service.

Finally, fine-tuning here is like transfer learning except that the training is primarily to ensure more consistent model output. In many cases, you could achieve the same through prompt engineering as well but depending on your scenario, you would want to compare the difference since the later approach typically means larger prompts.

For a more technical difference, this SO thread has a good discussion on this but note that the actual implementation details for OpenAI are not public AFAIK.