Share via

Do the documented OpenAI service quotas and limits also apply to OpenAI library in SynapseML?

Hiob Gebisso 121 Reputation points
2023-08-29T09:44:44.7033333+00:00

It seems that the pricing and limits are different when using the OpenAI API with the SynapseML library in a Synape Spark Notebook. I cannot find any cost incurred in the cost analysis of the openai resource group and the token rate limit seems to not apply here either. Is there any documentation or information on the quotas and limits for using the OpenAI library with SynapseML?

Azure Cost Management
Azure Cost Management
A Microsoft offering that enables tracking of cloud usage and expenditures for Azure and other cloud providers.
2,572 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,052 questions
0 comments
Accepted answer
  1. Ryan Hill 28,106 Reputation points Microsoft Employee
    2023-09-01T16:45:10.96+00:00

    Apologies for the late reply @Hiob Gebisso . I did reach out to the product group regarding quotas and limits.

    Currently, using Azure OpenAI with Synapse ML simply means you're bringing your own AOAI resource and providing the keys for authentication. Meaning, all consumption is based on the AOAI token rates and any quotas and limits from AOAI would be applicable.

    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.