Pricing clarification on embedding models

Aris Alder 0

I understand that if I run a 10k token document through text-search-curie-doc-001 that I will be charged on 10k tokens to embed.

However, when using text-search-curie-query-001, if I run a 50 token prompt/query, will I only be charged 50 tokens?

How does interacting with the 10k token document impact pricing? If the "similar" text found in the 10k token document is 500 tokens and the query is 50 tokens, is the charge 550 tokens?

Please expand if I am missing any key points in my logic.

Aris Alder 0 Reputation points

2023-03-25T17:05:26.9266667+00:00

So if your query is only 50 tokens, you will only be charged for those 50 tokens. if the similar text found in the 10k token document is 500 tokens and the query is 50 tokens, then the charge would be 550 tokens.

These are conflicting statements - so the official answer is that you are charged for the token amount of the query AND the similar text found and selected (say n=1), which in the example is 550? What documentation are you basing this off of?

I have searched far and wide through pricing documentation, and I was unable to find clarification on this exact detail.
Erkan Sahin 830 Reputation points

2023-03-26T20:17:52.94+00:00

You are correct that when using text-search-curie-doc-001, you will be charged for the number of tokens in the document that you want to embed.

Regarding your question about text-search-curie-query-001, you will only be charged for the number of tokens in the prompt/query that you submit. So if your query is only 50 tokens, you will only be charged for those 50 tokens.

When interacting with the 10k token document using text-search-curie-query-001, the charge will depend on the number of tokens in the prompt/query and the number of tokens in the matching text found in the document. In your example, if the similar text found in the 10k token document is 500 tokens and the query is 50 tokens, then the charge would be 550 tokens.

It's also worth noting that pricing for Azure Cognitive Services is based on usage, and the exact pricing can vary depending on a number of factors such as region, volume, and specific service features used. You can find more information about pricing for the Text Analytics API, which includes the text-search-curie-doc-001 and text-search-curie-query-001 services, on the Azure website.
YutongTie-MSFT 46,566 Reputation points

2023-03-30T01:05:43.2833333+00:00

Sorry @Aris Alder We are working with product team to make a clear pricing page to avoid confusion.