Do the documented OpenAI service quotas and limits also apply to OpenAI library in SynapseML?

Gebisso, Hiob, NM-M-PM 61 Reputation points
2023-08-29T09:44:44.7033333+00:00

It seems that the pricing and limits are different when using the OpenAI API with the SynapseML library in a Synape Spark Notebook. I cannot find any cost incurred in the cost analysis of the openai resource group and the token rate limit seems to not apply here either. Is there any documentation or information on the quotas and limits for using the OpenAI library with SynapseML?

Azure Cost Management
Azure Cost Management
A Microsoft offering that enables tracking of cloud usage and expenditures for Azure and other cloud providers.
1,413 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,046 questions
0 comments
Accepted answer
  1. Ryan Hill 21,286 Reputation points Microsoft Employee
    2023-09-01T16:45:10.96+00:00

    Apologies for the late reply @Gebisso, Hiob, NM-M-PM . I did reach out to the product group regarding quotas and limits.

    Currently, using Azure OpenAI with Synapse ML simply means you're bringing your own AOAI resource and providing the keys for authentication. Meaning, all consumption is based on the AOAI token rates and any quotas and limits from AOAI would be applicable.

    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest