Costing / Billing for using Azure OpenAI service

Question

Hi,

I am trying use Azure OpenAI service under Azure Cognitive services to develop a question and answering system on my company's data. Model will be developed using ChatGPT 3.5 turbo model / GPT 4 prompt & GPT 4 completion models.

Based on the cost shared in MS documentation & considering my scenario of using Chat bot by multiple users, i have calculated the cost and sharing my scenario for expert confirmation so that i can proceed for proposal to my organization.
please go through the same and comment on this:

Scenario:

Monthly charges of asking 100 question and average 200 token a day by using gpt 3.5 turbo model , what will be the monthly charges?

Sol.: Total number of tokens per day is 100x200x2 = 40000

Total number of tokens per month is 40000x24 = 960000

Total charges for tokens per month is 960000/1000*$0.002 = $1.92

Please let me know if the calculation done above is correct or not, since the monthly charges derived from the calculation are very minimal.

Thanks

Satish

Answer 1

@Satish Kumar , thank you for posting the question.

Yes, you are correct in your calculation considering you are taking 24 as the working days per month. Note that the actual bill generated will be based on the actual usage.

In addition to the pricing details, I would also suggest reviewing the links below to understand the limits and meaning of key terms used:

• Azure OpenAI Service quotas and limits
• Azure OpenAI Terms and Concepts

Hope this helps.

If the answer did not help, please add more context/follow-up question for it, and we will help you out. Else, if the answer helped, please click Accept answer so that it can help others in the community looking for help on similar topics.