Issue with missing usage values in completion payload when streaming

Jai-6363 240 Reputation points

When streaming is enabled, the completion payload is missing usage values. Can someone provide guidance on how to resolve this issue?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,298 questions
{count} votes

0 additional answers

Sort by: Most helpful