Setting a limit on Azure Open AI LLM

Matthew Gregoire 0 Reputation points
2024-08-13T13:01:36.8333333+00:00

How can I set a $50 limit on our Azure Open AI LLM?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,080 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Sam Cogan 10,812 Reputation points Microsoft Employee Volunteer Moderator
    2024-08-13T15:18:34.93+00:00

    You can't set a limit directly no. You can create a budget in Azure cost management to alert you when you hit a spend limit, and you can configure an action when that occurs, which could be used to delete the Open AI instance.

    See here for an example.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.