Share via

How to arrive at realistic OpenAI pricing on Azure for an app with 500K userbase?

Prashant Amara 0 Reputation points
2024-06-05T15:07:14.2566667+00:00

Dear Gurus/experts.

Looking for your expert nudging to the right resources that I must dive in to understand all aspects of pricing entailed in subscribing to OpenAI service on Azure.

We are in the process of developing an OpenAI based app with a large userbase of upto 500K per our estimate. Moved away from Tier based OpenAI subscription to Azure with a preliminary understanding (perhaps incomplete) that it would be almost limitless in terms of its ability to handle token traffic. Our estimate is a simultaneous peak access of upto 20K users per min. We have not yet translated this to actual/estimated token traffic though.

Earnestly looking for some expert guidance as to the checklist of likely Azure supporting products/services in addition to Open AI service that would be typically needed (on standby to be pointed to architecture considerations) and the meat of a realistic pricing awareness beyond the per token pay as you go pricing.

kind regards

Prashant

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,523 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. VasaviLankipalle-MSFT 15,836 Reputation points
    2024-06-07T16:26:31.0033333+00:00

    Hello @Prashant Amara , Thanks for using Microsoft Q&A Platform.

    I hope you have gone through the Azure OpenAI pricing: https://azure.microsoft.com/en-us/pricing/details/openai/ and the Azure pricing calculator to estimate the price for the Azure services: https://azure.microsoft.com/en-us/pricing/calculator/

    For deeper analysis on this matter, I would suggest raising a support ticket in the Azure portal helps.

    I hope this helps.

    Regards,

    Vasavi

    0 comments