Ask about DeploymentType of OpenAI Models

Question

Regarding the deployment type for OpenAI models:

• I've read the documentation here: https://learn.microsoft.com/es-es/azure/ai-services/openai/how-to/deployment-types
• However, I'm still unsure about which deployment type to use.
• In our company, we already have models deployed under the Standard type, and some consultant sugested us to switching to Global Standard, but I don't fully understand if this change would be beneficial.
• Im asking about this because in case of need to change de deployment type is necesary to delete the model, and create it again.
• Another point of concern is costs. Is there any significant cost difference in terms of tokens between Standard and Global Standard?

Additional Notes

I am specifically inquiring about Standard vs Global Standard.

I don't need clarification on other deployment types like Provisioned managed or others.Everything is clear in this case

Thanks!

Answer 1

@COLUSSI Diego M. TENARIS Thanks for reaching out to us, I would say cost and location are the points. A very important point is do you have any requirements for data residency. Some teams have limit on their data location, like some teams can not let their data go to other regions.

Global-Standard will have the higher default quota and larger number of models available than Standard. Traffic may be routed anywhere in the world. Data stored at rest remains in the designated Azure geography, while data may be processed for inferencing in any Azure OpenAI location. Learn more about data residency

Standard is better for customers with data residency requirements. Optimized for low to medium volume.

Another big difference is cost, most of the model is more expensive for regional deployment, please check on pricing page - https://azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/

I hope this helps.

Regards,

Yutong

-Please kindly accept the answer if you feel helpful to support the community, thanks a lot.