Token usage for prompt that triggered content filtering

Oleksii Filatov 0

When sending a message to a chat via GetChatCompletions as a response, I get a RequestFailedException. In the exception, I get an answer for which category content filter triggered, but nothing for how many tokens were used.

So my questions is: Do messages or responses that triggered the Content Filter not use tokens? If they do use tokens, how many are they using, and where can I get this information? Is the OpenAI Service using Content Safety?

Pramod Valavala 20,656 Reputation points Microsoft Employee

2023-10-27T22:11:02.6+00:00

@Oleksii Filatov AFAIK you just billed for the tokens processed by the model (so after content filtering for input and before content filtering for output) but I will confirm with the concerning team and get back here

Share via

Token usage for prompt that triggered content filtering

Your answer