Share via

Does calling the Assistant API generate additional tokens?

AdityaSa 801 Reputation points
2024-02-21T13:21:10.9866667+00:00

When calling the Assistant API, does it create additional tokens on top of the ones used for system and user prompts (messages)? Is code interpreter cost seperate?

Azure OpenAI in Foundry Models
0 comments No comments

1 answer

Sort by: Most helpful
  1. Ramr-msft 17,836 Reputation points
    2024-02-21T13:36:19.45+00:00

    Thanks for the question, Here is the document for Azure Open AI pricing. There are no additional tokens generated beyond the prompt and completions (inference tokens) from the base model used with each Assistant. Code interpreter cost is separate, but that has nothing to do with tokens generated.

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.