Azure openAI 8k limitation

Chris Wang 20 Reputation points
2023-07-17T16:39:45.5933333+00:00

Hello expert, I encounter 8k limitation for my turbo models which should be 16k. Is there any new access need to be applied or bug to be fixed?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,861 questions
0 comments No comments
{count} votes

Accepted answer
  1. YutongTie-MSFT 43,411 Reputation points
    2023-07-17T17:01:11.3166667+00:00

    Hello @Chris Wang

    Thanks for your information, this case has been escalated, and I just got a confirmation that this is a known issue which related to larger token volumes, to solve this issue, product team decided to do a purposeful pause for larger 16k requests.

    Please use lower 8k limits temporarily. This should be resolved in the this week, but at this time will have lower limits.

    I hope this helps, thanks for your understanding.

    Regards,

    Yutong

    -Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks a lot!

    0 comments No comments

0 additional answers

Sort by: Most helpful