Costing of Azure OpenAI service based on users or department

Question

Hi, We're planning to implement Chatbot using Azure OpenAI. Since the cost of using it fairly high (based on tokens and models), can anyone advise, if we can design the solution in a way, so that we can keep track of the cost of usage based on user (chatting user) or based on per department (where chatting user belongs) ? There's CosmosDB, Azure AI Search, Bot Service and App services also involved as part the solution.

Answer 1

Muhammad Shuja Greetings!

To track the cost of using Azure OpenAI Service based on the user or department, you can use Azure Cost Management.

You can check the cost analysis on the Azure OpenAI resource.

Under Resource Management, select Cost analysis. By default, cost analysis is scoped to the individual Azure OpenAI resource.

To understand the breakdown of what makes up that cost, it can help to modify Group by to Meter and in this case switching the chart type to Line.

Next use tags to track the cost of using Azure OpenAI Service based on the user or department. You can add tags to your Azure resources to categorize them in different ways, such as by department or user. When you add tags to your resources, you can use them to filter and group your cost data in Cost Management.

To add tags to your Azure resources, Once you have added tags to your resources, you can use them to filter and group your cost data in Cost Management.

To filter your cost data by tags, you can use the Filters pane in Cost analysis. You can select the tag you want to filter by and then select Apply. This will show you the cost of using Azure OpenAI Service for the resources that have the selected tag.

To group your cost data by tags, you can use the Group by pane in Cost analysis. You can select the tag you want to group by and then select Apply. This will show you the cost of using Azure OpenAI Service grouped by the selected tag.

Please see Plan to manage costs for Azure OpenAI Service and Apply tags with Azure portal for more details.

I hope this helps you track the cost of using Azure OpenAI Service based on the user or department.

Do let me know if that helps or have any further questions.