This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 63%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EXW%3C/text%3E%3C/svg%3E)
Why does gpt-35-turbo-1106 cost so much？
Between November 20th and November 22nd, I spent 97.95k Prompt tokens and 19.64k Completion tokens in gpt-35-turbo-1106, but it cost $6.92 in azure, is this normal?
openai pricing
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 74%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
xiansen wang Greetings!
Why does gpt-35-turbo-1106 cost so much？
As mentioned here Azure OpenAI Service Launches GPT-4 Turbo and GPT-3.5-Turbo-1106 Models
GPT-3.5 Turbo pricing is 3x most cost effective for input tokens and 2x more cost effective for output tokens compared to GPT-3.5 Turbo 16k. To deploy GPT-3.5-Turbo 1106 from the Studio UI, select version 1106. Version 1106 has separate quota from the existing versions of GPT-3.5 Turbo, enabling customers to start experimenting with it immediately without impacting existing GPT-3.5 deployments.
GPT-4 Turbo pricing is 3x most cost effective for input tokens and 2x more cost effective for output tokens compared to GPT-4, while offering more than 15x the context window. To deploy GPT-4-Turbo from the Studio UI, select version 1106-preview. Version 1106-preview has separate quota from the existing versions of GPT-4, enabling customers to start experimenting with it immediately without impacting existing GPT-4 deployments.
Between November 20th and November 22nd, I spent 97.95k Prompt tokens and 19.64k Completion tokens in gpt-35-turbo-1106, but it cost $6.92 in azure, is this normal?
As mentioned in the Azure OpenAI Announcements,
We are launching improved monitoring and observability capabilities for Azure OpenAI Service on the Azure Portal. With Azure OpenAI’s out-of-the-box metrics dashboard, customers can get a bird’s eye view of the most important usage and performance metrics for Azure OpenAI Service within seconds. You can understand the usage trends for your resource by breaking down API requests by model name, model version, deployment, operation and stream type (streaming or non-streaming), view error rates, latency, and utilization, among others. To get started, select your Azure OpenAI resource on Azure Portal, click on ‘Overview’ on the left pane and select ‘Monitoring’ on the right pane.
In addition, we are launching an enhanced metrics stack on Azure Monitor for Provisioned Throughput customers. As token costs vary significantly from model to model, we are launching ‘Active Tokens’ as an enhanced measure of your token utilization for provisioned deployments. Provisioned-managed customers can also understand the utilization % for their deployment and act when their calls are throttled when utilization exceeds 100%. Starting 11/27, customers will have a way to understand the latency of their streaming requests through the ‘Time to Response’ metric, which measures the time taken for the first response to appear after you have sent a response, excluding any client-side latency. Apart from the out-of-the-box dashboard, we have enhanced our Diagnostics Logs experience by adding deployment, model and response/request related schema to give you more granular visibility into your service usage.
Regarding the cost, I would suggest you, please raise a support ticket in the Azure portal by following this documentation: Create an Azure support request
Hope this information helps. Do let me know if you need any further help.
xiansen wang Did you get a chance to see my response?
Do let me know if that helps or have any further queries.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 71%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ET%3C/text%3E%3C/svg%3E)
Hey. I'm seeing similar weird cost accumulation. On a day, that we consumed 200K input tokens and 7k output tokens to gpt-35-turbo-1106 and nothing else, the daily cost was 6.3€ when I would anticipate it to be around 0.2€ with the pricing information provided. So that is around 30x steeper costs, not cool.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 69%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EXC%3C/text%3E%3C/svg%3E)
Same. Fix is plz, or I will cancel my subscribe:
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 21%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
same here, I've contacted with support team, and they confirm this incorrect pricing, don't know when to fix tho
later they did response to me, but the answer makes no sense, I reply again and they ask me to wait for another 2-3 days, so frustrating, still no response yet
Dec 4 2023, support team member emailed back to me, confirmed there are indeed some issues with the billing, let's wait then...
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 3%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDA%3C/text%3E%3C/svg%3E)
Any update? I am still seeing an issue between usage and cost. I am calculating that I am being charged $.015 / 1000 prompt tokens vs $.01 and $.05/1000 completion tokens, instead of $.03. Using GPT4-Turbo-128K (this is different than OP)
still no response
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 86%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EX%3C/text%3E%3C/svg%3E)
Has this problem been solved? How was it handled?
Excuse me, did you get a refund at the end?
I just went back in today, and found that there were some extra tokens showing up that had not shown before, and now my calculations are working out ok (I didn't use the service for a couple of days, to let the reporting catch up). I haven't tried this yet, but I wonder if your calculations would work out ok, if you looked at a specific range or date, a couple of days in the past.
My specific observations this morning are:
Completion tokens: 54.11k
Prompt tokens: 207.32k
Manually Calculated Complete Cost: 54.11 * .03 = 1.6233
Manually Calculated Prompt Cost: 207.32 * .01 = 2.0732
Manually Calculated Total Cost: 3.6965
Matches what I see in the Cost Analysis: $3.70
You mean that they might have added extra tokens to make the average token price to match the list prices? I didn't record the token usages for a certain period before so I can't have a chance to observe this.
But I did calculate just now about my December usage and the calculation works out ok also, it now matches the model price they listed.
Thanks for the update, I can finally use the model without worrying about the incorrect billing.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 32%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERM%3C/text%3E%3C/svg%3E)
Do we have an update on this? I’m currently beta-testing an application for pricing purposes and noticed this as well. It’s causing some confusion.
I think the pricing is normal now, just found out this morning. For the gpt-4-1106-preview I'm using, it's 0.01/1k prompt,0.03/1k completion for yesterday's cost.