About using GPT3.5 and GPT4 at the same time in Azure OpenAI

Ryuto Endo 20 Reputation points
2023-08-16T09:01:07.32+00:00

I would like to have GPT3.5 and GPT4 models at the same time. In that case,

  1. creating a GPT3.5 resource and a GPT4 resource, respectively
  2. creating a GPT3.5 model and a GPT4 model in one resource

There are two possible ways to do this. Which of these two methods is recommended? What would be the token limits, costs, etc. for each? Also, are there any concerns about coexistence of GPT3.5 and GPT4?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,048 questions
0 comments No comments
{count} votes

Accepted answer
  1. VasaviLankipalle-MSFT 17,121 Reputation points
    2023-08-16T22:15:20.8566667+00:00

    Hello @Ryuto Endo , Thanks for using Microsoft Q&A Platform.

    Firstly, you can certainly use multiple models in the same workspace.

    You can create separate resources for each model, or you can create multiple models in the same resource region if available. The recommended approach would depend on your specific use case and requirements.

    Please refer to the model page for the availability regions and the token limits: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models

    For pricing information, please visit here: https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/

    I hope this helps.

    Regards,
    Vasavi

    -Please kindly accept the answer and vote 'yes' if you feel helpful to support the community, thanks.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.