Does calling the Assistant API generate additional tokens?

AdityaSa 801 Reputation points
2024-02-21T13:21:10.9866667+00:00

When calling the Assistant API, does it create additional tokens on top of the ones used for system and user prompts (messages)? Is code interpreter cost seperate?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,798 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Ramr-msft 17,821 Reputation points
    2024-02-21T13:36:19.45+00:00

    Thanks for the question, Here is the document for Azure Open AI pricing. There are no additional tokens generated beyond the prompt and completions (inference tokens) from the base model used with each Assistant. Code interpreter cost is separate, but that has nothing to do with tokens generated.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.