Azure openai bring your own data token count

Question

Azure openai bring your own data token count

Sariga Rahul 146

How can I get the number of tokens used in the request for Azure OpenAI API when bringing my own data? The response from the API for default data includes the token count in the format shown below, but I am unable to find a way to retrieve the token count for my own data:

"usage": {
        "completion_tokens": 241,
        "prompt_tokens": 211,
        "total_tokens": 452
    }

Any guidance on how to retrieve this information would be greatly appreciated.

VasaviLankipalle-MSFT 18,676 Reputation points Moderator

2023-06-29T22:51:08.4066667+00:00

Hello @Sariga Rahul , Thanks for using Microsoft Q&A Platform.

Please allow some time to check internally and will get back to you on this.
Alexis 15 Reputation points

2023-07-28T03:14:31.2366667+00:00

Hello @VasaviLankipalle-MSFT ,

Any news on this ? Usually we can get data from using openai SDK, but since it does not support dataSources we cannot :( And the usage is not returned by basic answer without it.

Thanks,

Alexis

Your answer

VasaviLankipalle-MSFT 18,676 Reputation points Moderator

2023-06-29T22:51:08.4066667+00:00

Hello @Sariga Rahul , Thanks for using Microsoft Q&A Platform.

Please allow some time to check internally and will get back to you on this.
Alexis 15 Reputation points

2023-07-28T03:14:31.2366667+00:00

Hello @VasaviLankipalle-MSFT ,

Any news on this ? Usually we can get data from using openai SDK, but since it does not support dataSources we cannot :( And the usage is not returned by basic answer without it.

Thanks,

Alexis

Share via

Azure openai bring your own data token count

Your answer