Share via

Pricing for GPT-3.5 Turbo on Azure is not updated.

Sefank 15 Reputation points
2023-07-09T12:23:16.34+00:00

In the official Cognitive Services product team blog, we can see that the gpt-35-turbo model is priced with:

  • Prompt tokens: $0.0015 per 1,000 tokens
  • Completion tokens: $0.002 per 1,000 tokens

Also, the blog released the pricing of the gpt-35-turbo-16k model.

However, in the Azure Pricing Table website, the gpt-35-turbo model is still priced with $0.002 Per 1,000 tokens (with whatever Prompt or Completion). And there is no clue for the gpt-35-turbo-16k model here.

I wonder which pricing applys to current users. If the old pricing policy still applys now, is there an ETA for the new pricing policy?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,105 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,642 questions

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Konstantinos Passadis 19,591 Reputation points MVP
    2023-07-09T12:39:33.5366667+00:00

    Hello @Sefank !

    Welcome to Microsoft QnA!

    As we can read from the links :

    One of the biggest updates with the 0613 version is enhanced steerability via the system message. This means that the model is better at following the instructions that you outline in the system message which gives you the ability to further customize the behavior of the model or set guardrails to ensure the model is used responsibly.

     

    The 16k version of the model, gpt-35-turbo-16k, offers 4x the context length of the previous gpt-35-turbo model which will help you unlock scenarios requiring longer prompts.

     

    Both new gpt-35-turbo models will now have separate prices for prompt tokens and completion tokens:

    Prompt tokens Completion tokens
    gpt-35-turbo $0.0015 per 1,000 tokens $0.002 per 1,000 tokens
    gpt-35-turbo-16k $0.003 per 1,000 tokens $0.004 per 1,000 tokens

    This is the pricing that will gradually apply to all Open AI Tenants for specific tokens as bolded above
    Also if you notice the Pricing is matching the gpt-35-turbo for Completion Tokens ( per 1000) in Azure Pricing Page

    https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/#pricing

    Pricing details:

    Language models
    Standard
    gpt-3.5-turbo $0.002

    I hope this helps!

    Kindly mark the answer as Accepted and Upvote in case it helped!

    Regards

    2 people found this answer helpful.
  2. Konstantinos Passadis 19,591 Reputation points MVP
    2023-07-11T20:44:14.85+00:00

    Hello @Sefank !

    it is the same as 8k

    Thats why it is not shown

    Assume the same price for 8k and 16k and change from 32k and on!

    gpt-35-turbo-16k$ 0.003 per 1,000 tokens $0.004 per 1,000 tokens

    I hope this helps!

    Kindly mark the answer as Accepted and Upvote in case it helped!

    Regards

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.