About issue with using the GPT-4 model and API traffic busy response issue

buptle-admin 0 Reputation points
2023-11-10T04:47:49.8566667+00:00

Hello. I am a member of the development team at a company called buptle located in Korea. We are allocated OpenAI on MS Azure and are planning to conduct several POCs using the API for our service. We are encountering the following issues and are reaching out for assistance as finding precise solutions or instructions has been challenging. We would appreciate guidance on how to address the following problems:

Issue with using the GPT-4 model: The GPT-4 model does not seem to be available for selection. For your reference, the current region setting is Japan, East.

API traffic busy response issue: We frequently receive a "busy" message with a high probability, and when this occurs, no API response is received. The current inconvenience in working with this issue is significant. Is there a solution available for this problem?User's image

User's image

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
{count} votes

1 answer

Sort by: Most helpful
  1. navba-MSFT 27,605 Reputation points Microsoft Employee Moderator
    2023-11-10T06:43:34.67+00:00

    @buptle-admin Welcome to Microsoft Q&A Forum, Thank you for posting your query here!
    .
    I see that you have got access to Azure Open AI service however, you are not able to see GPT-4 models in OpenAI Studio at Japan East.
    .
    A separate application for Azure OpenAI GPT-4 is no longer needed.
    .

    Since you have already applied to the Azure OpenAI Service and your request is approved for the Azure OpenAI Service, you will have access to GPT-4 in a few selective regions only. See below screenshot:
    User's image

    GPT-4 and GPT-4-32k are now available to all Azure OpenAI Service customers. Availability varies by region.
    As mentioned in our docs for Japan East, Due to high demand, availability is limited in the region.
    .
    So, If you don't see GPT-4 in your region, please check back later. Alternatively, as a workaround, check if you can deploy resource to some other region which is mentioned above and check if that helps. More Info here.
    .

    If you have any follow-up questions, please let me know. I would be happy to answer.
    .

    **
    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.