Is BYOD more expensive than the Chat Playground?

Question

I set up a Bring Your Own Data (BOYD) chatbot on a GPT-3.5 16K model, but I noticed that the costs exceeded my expectations after just one day. When I checked the billing report, I saw that the majority of the costs were associated with the "Azure OpenAI - GPT35-Turbo-16K-1106 Input" product, which is priced at $0.03 per 1,000 requests. I'm wondering if this is an increased price for the BOYD preview. In my country, the pricing for the GPT-3 Turbo model is listed at $0.003 per 1,000 requests, and the only option I've seen so far billed at $0.03 per 1,000 requests is the GPT-4 8K. Can you clarify the pricing structure for the BOYD preview, please?

Answer 1

@The AI Consulting Firm Welcome to Microsoft Q&A Forum, Thank you for posting your query here!
.
The pricing for Azure OpenAI services can vary based on the model and the number of tokens used.
The pricing for the GPT-3.5 Turbo 16K model is $0.003 per 1,000 input tokens and $0.004 per 1,000 output tokens. The GPT-4 8K model is priced at $0.03 per 1,000 input tokens and $0.06 per 1,000 output tokens.
See the pricing page for more details.
.

As for the Bring Your Own Data (BOYD) chatbot, the cost would depend on the specific model you’re using. If you’re using the GPT-3.5 Turbo 16K model, then the costs should align with the pricing mentioned above. If you’re seeing a higher cost, it might be due to a large number of tokens being processed. Remember, both input and output tokens count towards the cost. More info here.
.
Note: Azure OpenAI on your data provides several search options you can use when you add your data source.
Semantic search and vector search are subject to additional pricing. You can use keyword search as the search type for no additional cost.

Regarding the Chat Playground, usage in the Playground is treated the same as regular API usage. So, the cost would again depend on the model and the number of tokens processed.

.
You can also leverage the Pricing calculator to estimate the cost for your usage. Please Add Azure OpenAi Service to estimate as shown below:

.
On a side note: If you’re seeing a discrepancy in your billing**,** I would suggest creating an Azure Billing support request and work with the support engineer to get these details. This type of request is included in Basic Support and a support engineer can work directly with you and provide the best possible solution. You can create an Azure Billing support request by following these steps:

1. Sign into the Azure portal.
2. Search for "Help + support" in the search bar.
3. Select "Help + support" from the search results.
4. Select "New support request".
5. Select "Billing" as the issue type.
6. Fill out the required information and submit the request.
   .
   The Support professionals will contact you and would be able to provide the most accurate information based on your specific usage and billing details.
   .

Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.

.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.