Tracking token usage for service calls on the server side

Jai-6363 245 Reputation points
2023-10-30T12:58:26.98+00:00

Is there a way to monitor the usage of tokens for each call into our service on the server side? We need to accurately track token usage for billing purposes, but the client-side usage doesn't provide a complete picture. we wants to be able to query the service or Azure cost management to see the actual usage with an API call. Are there any possible solutions?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,437 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,511 questions
0 comments No comments
{count} votes

0 additional answers

Sort by: Most helpful