Additional Tokens Generated by Assistant API

chaymr 181

I am using the Azure open ai assistant API, I am checking the azure costing for the assistant API, Does calling the Assistant API generate additional tokens, other than the system and user prompt message?

Saurabh Sharma 23,801 Reputation points Microsoft Employee

2024-02-22T00:26:56.42+00:00

Hi @chaymr
Welcome to Microsoft Q&A! Thanks for posting the question.

Other than token usage, if you are using code interpreter in assistants, then you will be charged additionally as per the pricing page.

Regarding additional tokens, I am checking internally on the same and get back to you.

Thanks Saurabh

1 answer

Saurabh Sharma 23,801 Reputation points Microsoft Employee

2024-02-22T22:11:18.22+00:00

Hi @chaymr

The Azure OpenAI Assistant API does not generate additional tokens other than the system and user prompt messages. The cost of using the Assistant API is based on the input and output tokens, and it varies depending on the GPT model used with each Assistant.

Please let me know if you have any other questions.

Thanks

Saurabh

Please 'Accept as answer' and Upvote if it helped so that it can help others in the community looking for help on similar topics.
Please sign in to rate this answer.
Saurabh Sharma 23,801 Reputation points Microsoft Employee

2024-03-06T21:33:19.04+00:00

Hi @chaymr

Please let me know if you find above reply useful. If yes, please 'Accept the answer' for the above reply. This will help other community members facing similar query to refer to this solution.

Thanks,

Saurabh
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Additional Tokens Generated by Assistant API

1 answer

Your answer