How do I get usage information from npm azure/openai client response

Question

How do I get usage information from npm azure/openai client response

Justin Liong Ching Hui 1

Hi, I have installed npm@azure/openai at version 1.0.0-beta.5

As I tried to use Chat Completions service through the OpenAIClient and getChatCompletions using the library, I was able to get the response successfully, inclusive of the message, choices etc.

However, I'm not able to find the field "usages" within the response for token accumulation for users (thus limiting excessive usage, NOT rate limit, just a total usage limitation per account)]

As I read up some existing documentations, I found that the usage field is inside NuGet version 1.0.0-beta.7, does this apply to JavaScript as well? (Such that, beta.5 does not have Usage field in its chat completion response as it is only available in beta.7 and above)

If so, is there any other way with which i could get the token information? User's image

This is a simple screenshot of the full response I have received with my app's front-end.

Ramr-msft 17,826 Reputation points

2023-09-01T09:20:08.5333333+00:00

@Justin Liong Ching Hui Thanks for the question, Yes, Please raise an issue in the repo. looks like you are looking for a simple usage pre calculator - Reference implementation for guidance https://github.com/liuliuOD/ChatGPT-Token-Usage-Pre-Calculator

Here is link to understand the cost management.

Your answer

Ramr-msft 17,826 Reputation points

2023-09-01T09:20:08.5333333+00:00

@Justin Liong Ching Hui Thanks for the question, Yes, Please raise an issue in the repo. looks like you are looking for a simple usage pre calculator - Reference implementation for guidance https://github.com/liuliuOD/ChatGPT-Token-Usage-Pre-Calculator

Here is link to understand the cost management.

Share via

How do I get usage information from npm azure/openai client response

Your answer