What are tokens?

Question

Joey Hurewitz 0

I was looking at the Azure tab, and it says for tokens. How does the price scale up? And how do I comprehend the prices?

Michael Durkan 12,241 Reputation points MVP

2023-08-08T21:48:54.2266667+00:00
Hi

what tokens are you referring you? Can you post a screenshot or more info as there a few different types of "tokens" that relate to different Azure technologies such as:

SAS Tokens

Tokens and Claims for Identity

Azure DevOps Personal Access Tokens (PAT)

Thanks

Michael
Joey Hurewitz 0 Reputation points

2023-08-08T21:52:17.2133333+00:00

I mean for Azure OpenAI. It mentions "per 1000 tokens." What are tokens in that context?
VasaviLankipalle-MSFT 18,676 Reputation points Moderator

2023-08-09T22:34:33.5366667+00:00

Hello @Joey Hurewitz , Thanks for using Microsoft Q&A Platform.

In the context of Azure OpenAI, tokens refer to the basic units of input and output that the service processes. Generally, the models understand and process text by breaking it down into tokens.

As mentioned by Michael Durkan, and David Broggy please refer to those documentations related to Tokens and the pricing.

Did you get a chance to check these responses?

3 answers

Michael Durkan 12,241 Reputation points MVP

2023-08-08T21:48:54.2266667+00:00

Hi

what tokens are you referring you? Can you post a screenshot or more info as there a few different types of "tokens" that relate to different Azure technologies such as:

SAS Tokens

Tokens and Claims for Identity

Azure DevOps Personal Access Tokens (PAT)

Thanks

Michael
Joey Hurewitz 0 Reputation points

2023-08-08T21:52:17.2133333+00:00

I mean for Azure OpenAI. It mentions "per 1000 tokens." What are tokens in that context?
VasaviLankipalle-MSFT 18,676 Reputation points Moderator

2023-08-09T22:34:33.5366667+00:00

Hello @Joey Hurewitz , Thanks for using Microsoft Q&A Platform.

In the context of Azure OpenAI, tokens refer to the basic units of input and output that the service processes. Generally, the models understand and process text by breaking it down into tokens.

As mentioned by Michael Durkan, and David Broggy please refer to those documentations related to Tokens and the pricing.

Did you get a chance to check these responses?

Answer 1

Michael Durkan 12,241 MVP

Hi

I would imagine this is what you are looking for:

Hope this helps,

Thanks

Michael Durkan

If the reply was helpful please upvote and/or accept as answer as this helps others in the community with similar questions. Thanks!

Answer 2

David Broggy 6,371 MVP Volunteer Moderator

The pricing for OpenAI token usage is listed here:

Answer 3

Janarthanan S 700

Hi Joey,

Greetings of the day!! Welcome to Microsoft Q&A Forum.

Detailed explanation of Tokens you can see in the Microsoft Documentation.

Pricing model you can navigate in the Microsoft Documentation.

I hope this answer will be helpful for you.

Regards,

Jana