Cost estimation of models

ird_infra 0 Reputation points
2023-10-11T08:13:38.7433333+00:00

Hi there,

I have one query. I am using Azure Open AI studio, there i can't be able to create a custom model. So i am using base models. Can you give me the cost estimation for each model. Also what's the type of fine-tuning used here?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,255 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Pramod Valavala 20,591 Reputation points Microsoft Employee
    2023-10-11T16:44:54.5866667+00:00

    @ird_infra For being able to create a custom model, you do not have the required Azure RBAC Role, addition to the regular role needed to manage the Azure OpenAI Resource itself.

    The Cognitive Services OpenAI Contributor and Cognitive Services Contributor should give permission to do every action in Azure OpenAI Studio.

    Do note that there are some differences in model availability by region and the pricing for each model can be found on the official pricing page for Azure OpenAI Service.

    Finally, fine-tuning here is like transfer learning except that the training is primarily to ensure more consistent model output. In many cases, you could achieve the same through prompt engineering as well but depending on your scenario, you would want to compare the difference since the later approach typically means larger prompts.

    For a more technical difference, this SO thread has a good discussion on this but note that the actual implementation details for OpenAI are not public AFAIK.

    0 comments No comments